-- Logs begin at Wed 2022-08-10 07:21:34 UTC, end at Wed 2022-08-10 08:29:53 UTC. -- Aug 10 07:56:45.407886 dv-cinder-781032-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 07:56:45.416505 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 07:56:45 2022] *** Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: nodename: dv-cinder-781032-4-iscsi Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: machine: x86_64 Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: clock source: unix Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: pcre jit disabled Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: detected number of CPU cores: 4 Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: current working directory: / Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: detected binary path: /usr/bin/uwsgi-core Aug 10 07:56:45.419099 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: your processes number limit is 47680 Aug 10 07:56:45.419917 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: your memory page size is 4096 bytes Aug 10 07:56:45.419917 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: detected max file descriptor number: 2048 Aug 10 07:56:45.419917 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: lock engine: pthread robust mutexes Aug 10 07:56:45.419917 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: thunder lock: enabled Aug 10 07:56:45.419917 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 07:56:45.419917 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 07:56:45.459227 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: Python main interpreter initialized at 0x560eb7d0a9c0 Aug 10 07:56:45.459227 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: python threads support enabled Aug 10 07:56:45.459227 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: your server socket listen backlog is limited to 100 connections Aug 10 07:56:45.459227 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: your mercy for graceful operations on workers is 90 seconds Aug 10 07:56:45.459634 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 07:56:45.459713 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: *** Operational MODE: preforking *** Aug 10 07:56:45.459939 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: *** uWSGI is running in multiple interpreter mode *** Aug 10 07:56:45.459939 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: spawned uWSGI master process (pid: 80371) Aug 10 07:56:45.460144 dv-cinder-781032-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 10 07:56:45.461393 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: spawned uWSGI worker 1 (pid: 80381, cores: 1) Aug 10 07:56:45.461393 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: spawned uWSGI worker 2 (pid: 80382, cores: 1) Aug 10 07:56:45.461393 dv-cinder-781032-4-iscsi devstack@keystone.service[80371]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 07:56:50.940863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:56:50.940863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: from cryptography.utils import int_from_bytes Aug 10 07:56:50.941662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:56:50.941662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: from cryptography.utils import int_from_bytes Aug 10 07:56:50.944176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:56:50.944176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: from cryptography.utils import int_from_bytes Aug 10 07:56:50.944643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 07:56:50.944643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: from cryptography.utils import int_from_bytes Aug 10 07:56:50.994007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 07:56:50.994215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 07:56:50.994369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] command line args: [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 07:56:50.994474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 07:56:50.994562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 07:56:50.994644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 07:56:50.994748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] command line args: [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 07:56:50.994832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ================================================================================ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 07:56:50.995016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 07:56:50.995116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] admin_token = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.995198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ================================================================================ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 07:56:50.995273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config_dir = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.995492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.995601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] admin_token = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.995687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config_source = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.995847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] debug = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.995936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config_dir = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config_source = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] debug = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.996900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_config_append = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.997921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_dir = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.998064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.998231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.998407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.998570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_config_append = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.998715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.998880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.998880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_dir = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:50.999977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.000896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.001086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.001184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.001376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.001512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.002199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.002451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.002550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.002705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] publish_errors = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.002825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.002948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.003120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.003206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.003325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.003503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.003636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.003820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.003909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.004058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] standard_threads = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.004290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.004537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.004618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.004710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.004793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] publish_errors = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.004876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_journal = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_json = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_stderr = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_syslog = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.005867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.005962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.006091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.006202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.006353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.006506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] standard_threads = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.006594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.006808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.006899 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.007057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.007146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.007307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.007389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.007552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_journal = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.007644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.007754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_json = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.007882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.007972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_stderr = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.008133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.008216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_syslog = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.008384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.008467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 07:56:51.008619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.008745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.008867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.009057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.009150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.009337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.009425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.009585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.009722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.009825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.010060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.010150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.010325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.010415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.010567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.010713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.010812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.011044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.011129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.011308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.011396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.011596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.011783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.011886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.012069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.012177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.012300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.012533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.012650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.013161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.013161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.013161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.013937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.013937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.014955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.015999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.016938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.017019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.017182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.017317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.017463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.017992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.018901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.019966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.020046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.020194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.020274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.020427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.021978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.022915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.023924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.024909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.025867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.026921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.027967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028212 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.028914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.029995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.030920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.031960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.032889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.external = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.033991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.password = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.token = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.034936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.external = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.password = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.035923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.token = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036395 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.036868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.037960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.038920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.039918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040234 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.040989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.041159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.041242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.041395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.041479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.041647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.041759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.041883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.042982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.043112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.043242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.043372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.043520 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.043651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.043805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.043935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.044064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.044195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.044326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.044531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.044662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.044790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.044921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.045991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046802 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.046949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.047988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.048072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.048224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.048308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.048493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.048672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.049930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.050878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.051850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.052937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.053955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.054883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.055998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.056929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.057961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.058867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.059822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.060236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.060333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.060473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.060556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.060710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.060793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.060936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.061951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.062889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.063865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.064002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.064578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.064835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.065985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.066895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.067882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.068966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.069953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.070910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.071990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.072077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.072237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.072467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.072552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.072702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.072784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.072948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.073973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074412 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.074971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.075971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.076902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.077845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.078940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.079021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.079181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.079261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.079462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.079563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.079671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.079839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.080950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.081928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.082974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.083930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.084960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 07:56:51.085033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.085249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.085486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.085715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.085951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.086181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 07:56:51.086347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 07:56:51.114047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.114264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.114371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.114480 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.114570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.114741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.124143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.124517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.152908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.153132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.153469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.153705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.204592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.205443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.255309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.255552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.255647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.255879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.320868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.321979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.322110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.322326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.345091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.345330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.345602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.345602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.346080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.346264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.346475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.346562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.346894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.347300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.347749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.348002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.348224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.348442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.357745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.358982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.370996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.371227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.371407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.371534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.371662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.371748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.371881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.371965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.372094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.372181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.372303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.372389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.372515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.372730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 07:56:51.389429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.389637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:56:51.389930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.390017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.390145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:56:51.390247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:56:51.390422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.390507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.390672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 07:56:51.390756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.390927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.391014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.391180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.391263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.391458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.391720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.402558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.402833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.403099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.403325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.403431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.403638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.403908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.404192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.410360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.411349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.413413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.413698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.413983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.414259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.414461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.414546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.414747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.414846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.415951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.416133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.416228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.416407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.416678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.416950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.417219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.440455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.441754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.441955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.442244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.443241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.443549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.446881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.447164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.447466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.448150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.448437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.448719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.453959 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.454241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.455505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.455747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.458258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.458549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.458825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.459101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.459368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.459659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.459831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.459924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.460124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.460216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.460416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.460708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.461275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.461560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.461825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.475636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.475912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.477743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.478025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.479842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.482060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.482957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.483247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.485225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.485523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.488370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.490482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.491547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.493664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.494648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.494943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.495226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.495558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.495837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.496120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.496836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.497137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.497419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.497710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.497988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.498263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.512797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.513084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.513348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.513606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.514823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.515119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.515389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.515680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.520761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.522307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.522582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.522670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.524174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.524453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.525391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.525672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.525972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.526258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.526532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.527254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.527563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.527859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.528150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.528437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.538019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.538302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.538579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.538856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.539132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.539403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.539699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.539921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.540210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.540492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.540773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.541052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.541329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.541606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.556739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.558690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.559679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.561938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.562832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.564496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.565320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.565976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.566254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.566538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.566910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.568448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.568744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.569025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.572924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.574521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.575471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.577064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.577420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.577707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.577982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.578260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.580561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.580851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.581135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.581407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.586854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.587141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.587494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.589440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.589734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.590014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.594489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.594770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.595046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.595343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.595664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.595955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.596225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.596494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.596868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.597087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 07:56:51.597174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.597375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.597460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.597654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.597746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.597920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.598005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.598177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.598310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.598456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.598731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.598998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.599379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.599696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.599970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.600243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.600518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.600777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 07:56:51.631578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560eb7d0a9c0 pid: 80382 (default app) Aug 10 07:56:51.634651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560eb7d0a9c0 pid: 80381 (default app) Aug 10 07:56:51.634858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b662-73b4-4818-b614-0689b5a86ad9 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:51.635138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b662-73b4-4818-b614-0689b5a86ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:51.635403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b662-73b4-4818-b614-0689b5a86ad9 None None] PATH_INFO: `/v3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:51.639661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Wed Aug 10 07:56:51 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:56:59.370142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95145-1873-48f1-9c92-abe6317df3a2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:59.370683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95145-1873-48f1-9c92-abe6317df3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:59.370683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95145-1873-48f1-9c92-abe6317df3a2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:59.375086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:56:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:56:59.380991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:56:59.381425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:56:59.381520 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:56:59.451673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: INFO dbcounter [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] Registered counter for database keystone Aug 10 07:56:59.470932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG oslo_db.sqlalchemy.engines [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 07:56:59.477105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writer thread running {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 07:56:59.655994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG passlib.handlers.bcrypt [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80382) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 07:56:59.656331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG passlib.handlers.bcrypt [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80382) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 07:56:59.711310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:56:59.712944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:56:59.841075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:56:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 10 07:57:00.034276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba95145-1873-48f1-9c92-abe6317df3a2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:00.103684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: INFO dbcounter [None req-cba95145-1873-48f1-9c92-abe6317df3a2 None None] Registered counter for database keystone Aug 10 07:57:00.125428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG oslo_db.sqlalchemy.engines [None req-cba95145-1873-48f1-9c92-abe6317df3a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 07:57:00.132514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writer thread running {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 07:57:00.247885 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba95145-1873-48f1-9c92-abe6317df3a2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:00.253215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d189f-7e41-4d3c-b177-15982e16e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:00.254597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d189f-7e41-4d3c-b177-15982e16e97b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:00.254597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d189f-7e41-4d3c-b177-15982e16e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:00.254597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d189f-7e41-4d3c-b177-15982e16e97b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:00.262665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d189f-7e41-4d3c-b177-15982e16e97b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:00.315092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4a3d189f-7e41-4d3c-b177-15982e16e97b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 07:57:00.315454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d189f-7e41-4d3c-b177-15982e16e97b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:00.325287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 10 07:57:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 07:57:00.333537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:00.347727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133444b-a103-4a91-894e-bb5568ef609b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:00.352123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79a4fd-a5f2-4e11-a40a-bebbc83b0d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:00.353230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a4fd-a5f2-4e11-a40a-bebbc83b0d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:00.353505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a4fd-a5f2-4e11-a40a-bebbc83b0d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:00.353770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79a4fd-a5f2-4e11-a40a-bebbc83b0d6d admin admin] PATH_INFO: `/v3/projects/f1162a60112e4fd8987d9e032506b0a6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:00.355198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79a4fd-a5f2-4e11-a40a-bebbc83b0d6d admin admin] RBAC: Authorizing `identity:get_project(project_id=f1162a60112e4fd8987d9e032506b0a6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:00.405812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4d79a4fd-a5f2-4e11-a40a-bebbc83b0d6d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 07:57:00.406418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79a4fd-a5f2-4e11-a40a-bebbc83b0d6d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:00.411235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Wed Aug 10 07:57:00 2022] GET /identity/v3/projects/f1162a60112e4fd8987d9e032506b0a6 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:02.386782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fbc1a-3729-42e7-a3ba-068f9d914a13 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:02.387273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fbc1a-3729-42e7-a3ba-068f9d914a13 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:02.387363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fbc1a-3729-42e7-a3ba-068f9d914a13 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:02.391406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:02.397182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf5201-e20e-4fd8-99fe-eabc1a4c9cdf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:02.397619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf5201-e20e-4fd8-99fe-eabc1a4c9cdf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:02.397715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf5201-e20e-4fd8-99fe-eabc1a4c9cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:02.418546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7dbf5201-e20e-4fd8-99fe-eabc1a4c9cdf None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:02.420103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7dbf5201-e20e-4fd8-99fe-eabc1a4c9cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:02.428248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 07:57:02.450577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fbc1a-3729-42e7-a3ba-068f9d914a13 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:02.463195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fbc1a-3729-42e7-a3ba-068f9d914a13 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:02.467396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd494f-7b00-4f01-977a-b044cf0784e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:02.468009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd494f-7b00-4f01-977a-b044cf0784e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:02.468291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd494f-7b00-4f01-977a-b044cf0784e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:02.468565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd494f-7b00-4f01-977a-b044cf0784e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:02.476309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd494f-7b00-4f01-977a-b044cf0784e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:02.478081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd494f-7b00-4f01-977a-b044cf0784e2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:02.486769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 10 07:57:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 07:57:02.491926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf5201-e20e-4fd8-99fe-eabc1a4c9cdf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:02.500737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf5201-e20e-4fd8-99fe-eabc1a4c9cdf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:02.505866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e1f8-a38c-4bc4-9202-503234592d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:02.506491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e1f8-a38c-4bc4-9202-503234592d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:02.506770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e1f8-a38c-4bc4-9202-503234592d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:02.507044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e1f8-a38c-4bc4-9202-503234592d6c admin admin] PATH_INFO: `/v3/users/0c35a81a1058405d92e858b7156195a3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:02.508397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219e1f8-a38c-4bc4-9202-503234592d6c admin admin] RBAC: Authorizing `identity:get_user(user_id=0c35a81a1058405d92e858b7156195a3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:02.510210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219e1f8-a38c-4bc4-9202-503234592d6c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:02.511754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Wed Aug 10 07:57:02 2022] GET /identity/v3/users/0c35a81a1058405d92e858b7156195a3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:04.561795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09648e-cd5b-452d-a4f0-81d4f1c8d3d7 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:04.562296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09648e-cd5b-452d-a4f0-81d4f1c8d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:04.562296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09648e-cd5b-452d-a4f0-81d4f1c8d3d7 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:04.563803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:04.568890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc5238-6bcd-43c1-b6a1-fb7ea2d67225 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:04.569283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc5238-6bcd-43c1-b6a1-fb7ea2d67225 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:04.569629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc5238-6bcd-43c1-b6a1-fb7ea2d67225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:04.586999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-45bc5238-6bcd-43c1-b6a1-fb7ea2d67225 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:04.588174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-45bc5238-6bcd-43c1-b6a1-fb7ea2d67225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:04.609488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd055cbf-4c5a-4c5b-a0c7-d7d34540c053 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:04.609853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd055cbf-4c5a-4c5b-a0c7-d7d34540c053 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:04.610137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd055cbf-4c5a-4c5b-a0c7-d7d34540c053 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:04.612231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:04.617225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:04.617510 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:04.617787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:04.661140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG passlib.handlers.bcrypt [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80381) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 07:57:04.661556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG passlib.handlers.bcrypt [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80381) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 07:57:04.669561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:04.693044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc5238-6bcd-43c1-b6a1-fb7ea2d67225 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:04.708430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:04.710052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:04.715662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:04.796772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc5238-6bcd-43c1-b6a1-fb7ea2d67225 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:04.809946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:04.829935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:04.830496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:04.830770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:04.831039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:04.832290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:04.842187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:04.851376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:04.852314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:04.853341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:04.858282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:04.930716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8bd66-d19e-4cd7-9f82-8aace86327cf None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:04.933013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:04.939187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:04.958309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c36e2-8237-4bd4-804c-c9004a069533 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:04.971914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:04.972775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:04.973050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:04.973315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:04.992853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:04.993458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:04.993738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:04.994014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:04.994677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:04.994980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:04.996408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:05.007894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:05.013571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:05.040916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:05.042456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:05.144997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:57:05.150971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:05.154135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:05.221525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375190-a86d-445f-bfb6-a7550035db9c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:05.252294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cab33-eb07-4a43-90b6-7e050d8a0453 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:05.254279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:05.254897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:05.255170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:05.255456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] PATH_INFO: `/v3/users/0c35a81a1058405d92e858b7156195a3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:05.256572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] RBAC: Authorizing `identity:get_user(user_id=0c35a81a1058405d92e858b7156195a3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:05.258010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:05.259580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:05 2022] GET /identity/v3/users/0c35a81a1058405d92e858b7156195a3 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:05.265014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:05.280123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:05.287789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:05.288643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:05.288955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:05.291709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:05.310354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:05.311895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:57:05.330995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:05.331997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:57:05.332819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:57:05.332819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:57:05.332819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:05.332819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:05.338069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:05.371132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a6b89-b542-42fc-ad65-a0db9f315162 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:05.393974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:05.404268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:05.404827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:05.405101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:05.405543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:05.406652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:05.408142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:05.409672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:05.415313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:05.436915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd1723-d0b8-43e4-95a8-31a929bf0b07 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:05.470814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89a47f-92fd-4dbf-adbf-263d930aaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:05.471442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89a47f-92fd-4dbf-adbf-263d930aaf88 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:05.471707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89a47f-92fd-4dbf-adbf-263d930aaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:05.471974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89a47f-92fd-4dbf-adbf-263d930aaf88 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:05.472605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89a47f-92fd-4dbf-adbf-263d930aaf88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:05.472901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89a47f-92fd-4dbf-adbf-263d930aaf88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:05.474268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89a47f-92fd-4dbf-adbf-263d930aaf88 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:05.491661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:05.494866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:05.516147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2ed8b-ede8-4be8-8c8a-f3b3562346c6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:05.557393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29bdab-4878-4eca-8f37-ea47f918b6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:05.558018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29bdab-4878-4eca-8f37-ea47f918b6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:05.558296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29bdab-4878-4eca-8f37-ea47f918b6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:05.558573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29bdab-4878-4eca-8f37-ea47f918b6b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:05.559310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29bdab-4878-4eca-8f37-ea47f918b6b1 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.domain.id=default, user.id=0c35a81a1058405d92e858b7156195a3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:05.559912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29bdab-4878-4eca-8f37-ea47f918b6b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:05.561401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29bdab-4878-4eca-8f37-ea47f918b6b1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:05.569770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 10 07:57:05 2022] GET /identity/v3/role_assignments?user.id=0c35a81a1058405d92e858b7156195a3&scope.domain.id=default&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:08.064725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2cd7c-3193-4053-a08e-361f507ba7df None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.065738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2cd7c-3193-4053-a08e-361f507ba7df None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.066213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2cd7c-3193-4053-a08e-361f507ba7df None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.068024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:08.073135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98eb7-4d45-4626-9773-96c32d4beed7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.073933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98eb7-4d45-4626-9773-96c32d4beed7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.074413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98eb7-4d45-4626-9773-96c32d4beed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.100390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-44b98eb7-4d45-4626-9773-96c32d4beed7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:08.101901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-44b98eb7-4d45-4626-9773-96c32d4beed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:08.182764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c8e89-8b47-42a6-860a-a24a29b2a9fe None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.183403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c8e89-8b47-42a6-860a-a24a29b2a9fe None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.183896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c8e89-8b47-42a6-860a-a24a29b2a9fe None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.185645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 12/23] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:08.188757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:08.192070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93193a-5de3-456a-a770-d0a8c7099a13 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.192579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93193a-5de3-456a-a770-d0a8c7099a13 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.193057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93193a-5de3-456a-a770-d0a8c7099a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.229789 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98eb7-4d45-4626-9773-96c32d4beed7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:08.232962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fd93193a-5de3-456a-a770-d0a8c7099a13 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:08.234385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fd93193a-5de3-456a-a770-d0a8c7099a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:08.359023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:08.379854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:08.380927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd907d18-2b45-422a-a016-49406a838c00 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.381905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd907d18-2b45-422a-a016-49406a838c00 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.382395 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd907d18-2b45-422a-a016-49406a838c00 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.383949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 14/26] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:08.389900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75974277-f451-4577-9d09-d3d191b1c16a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.390541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75974277-f451-4577-9d09-d3d191b1c16a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.391963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75974277-f451-4577-9d09-d3d191b1c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.404812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98eb7-4d45-4626-9773-96c32d4beed7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:08.428205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-75974277-f451-4577-9d09-d3d191b1c16a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:08.429386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-75974277-f451-4577-9d09-d3d191b1c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:08.474024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:08.475796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.476085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.476355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.497310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:08.498789 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:08.513116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:57:08.530396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:08.531357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:57:08.532246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:57:08.532246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:57:08.532246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:08.532246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 13/27] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:08.532639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:08.556788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 15/28] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:08.557712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75974277-f451-4577-9d09-d3d191b1c16a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:08.713068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8f7a-1a4a-4f43-857e-7cca68970bed None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:08.762102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758a5d3-4fc3-47e6-8164-b2b8149fdd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:08.762953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758a5d3-4fc3-47e6-8164-b2b8149fdd26 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.763396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758a5d3-4fc3-47e6-8164-b2b8149fdd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.767904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758a5d3-4fc3-47e6-8164-b2b8149fdd26 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.768756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758a5d3-4fc3-47e6-8164-b2b8149fdd26 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:08.770312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758a5d3-4fc3-47e6-8164-b2b8149fdd26 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:08.783647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:08.802391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75974277-f451-4577-9d09-d3d191b1c16a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:08.838771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:08.839380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.839680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.839951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.840594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:08.840891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:08.842268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:08.855058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 16/29] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:08.855652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:08.893475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:08.917939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 14/30] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 07:57:08 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:08.924746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d13be-a305-4cbb-8e8b-ebbd24c06abf None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:08.925027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d13be-a305-4cbb-8e8b-ebbd24c06abf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:08.925302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d13be-a305-4cbb-8e8b-ebbd24c06abf None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:08.926923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 15/31] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:08.927708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d13be-a305-4cbb-8e8b-ebbd24c06abf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:08.968811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503dda9-7d5f-47ab-9a28-c378597a7007 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.007387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7c42-dd52-48df-90f9-b472f8e86df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.008070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7c42-dd52-48df-90f9-b472f8e86df8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.008343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7c42-dd52-48df-90f9-b472f8e86df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.008613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7c42-dd52-48df-90f9-b472f8e86df8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.022830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7c42-dd52-48df-90f9-b472f8e86df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-7f2e7c42-dd52-48df-90f9-b472f8e86df8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:09.029457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:09.030500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:09.031249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 17/32] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:09.031963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71703e-80b2-46cf-a97d-13029d95d526 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.033619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71703e-80b2-46cf-a97d-13029d95d526 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.033619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71703e-80b2-46cf-a97d-13029d95d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.060681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3b71703e-80b2-46cf-a97d-13029d95d526 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:09.061900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3b71703e-80b2-46cf-a97d-13029d95d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:09.131724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d13be-a305-4cbb-8e8b-ebbd24c06abf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.139311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 18/33] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:09.140186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71703e-80b2-46cf-a97d-13029d95d526 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.169249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:09.190416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f89e-b477-44c7-93e3-a70b1d650a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.191489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f89e-b477-44c7-93e3-a70b1d650a4c None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.192234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f89e-b477-44c7-93e3-a70b1d650a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.192963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f89e-b477-44c7-93e3-a70b1d650a4c None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.193860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f89e-b477-44c7-93e3-a70b1d650a4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:09.196267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f89e-b477-44c7-93e3-a70b1d650a4c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:09.229291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 16/34] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:57:08 2022] POST /identity/v3/projects => generated 301 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:09.230786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb23118-45f2-4747-8436-79bd67ddd3a2 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.231263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb23118-45f2-4747-8436-79bd67ddd3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.231730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb23118-45f2-4747-8436-79bd67ddd3a2 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.233213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 17/35] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:09.238844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb23118-45f2-4747-8436-79bd67ddd3a2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.278241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71703e-80b2-46cf-a97d-13029d95d526 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.290309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:09.330641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c5c5c-b866-46f0-ad74-94638fd9fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.331268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c5c5c-b866-46f0-ad74-94638fd9fea3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.331600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c5c5c-b866-46f0-ad74-94638fd9fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.331846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c5c5c-b866-46f0-ad74-94638fd9fea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.332529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c5c5c-b866-46f0-ad74-94638fd9fea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:09.332831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c5c5c-b866-46f0-ad74-94638fd9fea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:09.334238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c5c5c-b866-46f0-ad74-94638fd9fea3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:09.352878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 19/36] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:09.352878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012563-d234-40ee-89be-1129082e9884 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.352878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012563-d234-40ee-89be-1129082e9884 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.352878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012563-d234-40ee-89be-1129082e9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.369731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-86012563-d234-40ee-89be-1129082e9884 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:09.370940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-86012563-d234-40ee-89be-1129082e9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:09.375049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb23118-45f2-4747-8436-79bd67ddd3a2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.418466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417f7dd-2a61-455c-98bc-c54235ab5e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.419127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417f7dd-2a61-455c-98bc-c54235ab5e9e None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.419797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417f7dd-2a61-455c-98bc-c54235ab5e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.420082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417f7dd-2a61-455c-98bc-c54235ab5e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.421454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417f7dd-2a61-455c-98bc-c54235ab5e9e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:09.423882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417f7dd-2a61-455c-98bc-c54235ab5e9e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:09.442512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 07:57:09 2022] POST /identity/v3/roles => generated 225 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:09.444093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9f6f0-0b71-4523-ad0a-5f62ab3d8477 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.444577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9f6f0-0b71-4523-ad0a-5f62ab3d8477 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.445073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9f6f0-0b71-4523-ad0a-5f62ab3d8477 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.446567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 19/38] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:09.447398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9f6f0-0b71-4523-ad0a-5f62ab3d8477 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.453544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 20/39] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:09.455357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0762a-7f09-421d-997f-d82543618a22 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.455897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0762a-7f09-421d-997f-d82543618a22 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.456532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0762a-7f09-421d-997f-d82543618a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.476725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4ce0762a-7f09-421d-997f-d82543618a22 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:09.478151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4ce0762a-7f09-421d-997f-d82543618a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:09.495891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:09.561008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 21/40] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:09.561652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0762a-7f09-421d-997f-d82543618a22 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.590102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:09.596590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9f6f0-0b71-4523-ad0a-5f62ab3d8477 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.640127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.641039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.641392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.641925 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] PATH_INFO: `/v3/users/0c35a81a1058405d92e858b7156195a3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.642762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] RBAC: Authorizing `identity:get_user(user_id=0c35a81a1058405d92e858b7156195a3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:09.644405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:09.646737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 20/41] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:09 2022] GET /identity/v3/users/0c35a81a1058405d92e858b7156195a3 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:09.646888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.681984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0762a-7f09-421d-997f-d82543618a22 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.717132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.717741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.718017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.718292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.718947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:09.721406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:09.750139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964db71-9636-4944-a0df-e2d76fb911fc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.782848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.783494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.783790 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.784045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.785160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:09.786591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:09.788167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 21/42] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:09.788904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.824153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:09.847139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 22/43] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 07:57:09 2022] POST /identity/v3/roles => generated 223 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:09.848125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.861506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:09.903011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b8dea-7e9a-4399-b270-24d76c3e2e52 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:09.944740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:09.945387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:09.945663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:09.945932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:09.947152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:09.948690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:09.950625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 22/44] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:09.956666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:09.970918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fad00-42cf-4d52-a3a2-5b1b34176075 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:10.014514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe0ad0-a46c-4627-a49a-8147786c8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:10.015068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0ad0-a46c-4627-a49a-8147786c8ba6 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:10.015351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0ad0-a46c-4627-a49a-8147786c8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:10.015659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0ad0-a46c-4627-a49a-8147786c8ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:10.017241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe0ad0-a46c-4627-a49a-8147786c8ba6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:10.018859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe0ad0-a46c-4627-a49a-8147786c8ba6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:10.054026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 23/45] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:57:09 2022] POST /identity/v3/projects => generated 312 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:10.084103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328102-4285-442e-822c-71a9a4f3933c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:10.085825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:10.121245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38ceab-c29b-4d3a-a4f1-63fc55f884e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:10.121984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ceab-c29b-4d3a-a4f1-63fc55f884e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:10.122237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ceab-c29b-4d3a-a4f1-63fc55f884e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:10.122518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38ceab-c29b-4d3a-a4f1-63fc55f884e6 None admin] PATH_INFO: `/v3/domains/default/users/0c35a81a1058405d92e858b7156195a3/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:10.124642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38ceab-c29b-4d3a-a4f1-63fc55f884e6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0c35a81a1058405d92e858b7156195a3, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:10.126200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38ceab-c29b-4d3a-a4f1-63fc55f884e6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:10.140539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 23/46] 10.222.0.40 () {58 vars in 1361 bytes} [Wed Aug 10 07:57:09 2022] PUT /identity/v3/domains/default/users/0c35a81a1058405d92e858b7156195a3/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:57:12.115723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d254187-0aea-4a36-b0d0-e83ad459a785 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.116247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d254187-0aea-4a36-b0d0-e83ad459a785 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.116352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d254187-0aea-4a36-b0d0-e83ad459a785 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.117625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 24/47] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:12.122709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf2a4-ce1b-468f-9e58-630354b56f18 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.123146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf2a4-ce1b-468f-9e58-630354b56f18 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.123263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf2a4-ce1b-468f-9e58-630354b56f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.142504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d5ccf2a4-ce1b-468f-9e58-630354b56f18 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:12.144044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d5ccf2a4-ce1b-468f-9e58-630354b56f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:12.154612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985c34-f672-4f24-9559-5205aed6f435 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.154892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985c34-f672-4f24-9559-5205aed6f435 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.155166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985c34-f672-4f24-9559-5205aed6f435 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.156531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 25/48] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:12.161449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910d05b-266b-4dd7-82c2-8570825a0f96 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.161727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910d05b-266b-4dd7-82c2-8570825a0f96 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.162006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910d05b-266b-4dd7-82c2-8570825a0f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.179727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a910d05b-266b-4dd7-82c2-8570825a0f96 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:12.181254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a910d05b-266b-4dd7-82c2-8570825a0f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:12.210683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 24/49] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:12.233248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf2a4-ce1b-468f-9e58-630354b56f18 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:12.238374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:12.251229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 26/50] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:12.274043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910d05b-266b-4dd7-82c2-8570825a0f96 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:12.326105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:12.335948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf2a4-ce1b-468f-9e58-630354b56f18 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:12.370171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:12.370719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.370994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.371265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.372394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:12.373849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:12.374028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910d05b-266b-4dd7-82c2-8570825a0f96 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:12.375437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 25/51] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:12.381088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:12.412346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:12.412977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.413264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.413538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.423972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:12.428716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:12.429547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:12.430449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 27/52] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:12.436449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:12.486641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:12.490298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7a19e-bf5b-4095-b5a8-edad332c366b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:12.524709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:12.525308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.525586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.525858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.526493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:12.527966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:12.536585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a136b-4fd2-4c7d-bbb3-67c25454d2b4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:12.555310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 26/53] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 10 07:57:12 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:57:12.574260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:12.575008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.575169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.575509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.576153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:12.576541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:12.577954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:12.588518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 28/54] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:12.594633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:12.611540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:12.703309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8e34d-1378-45b1-a939-32ec1c43458f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:12.739134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:12.739800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.740082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.740355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] PATH_INFO: `/v3/users/0c35a81a1058405d92e858b7156195a3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.741502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] RBAC: Authorizing `identity:get_user(user_id=0c35a81a1058405d92e858b7156195a3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:12.743010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:12.745052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:12 2022] GET /identity/v3/users/0c35a81a1058405d92e858b7156195a3 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:12.751324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:12.851674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27571-194f-439a-a404-a4e5c1322983 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:12.864724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:12.885411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142306d-7317-4420-9bfd-8f37aaa9f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:12.886100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142306d-7317-4420-9bfd-8f37aaa9f803 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:12.886382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142306d-7317-4420-9bfd-8f37aaa9f803 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:12.886711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142306d-7317-4420-9bfd-8f37aaa9f803 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:12.887857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142306d-7317-4420-9bfd-8f37aaa9f803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:12.889290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142306d-7317-4420-9bfd-8f37aaa9f803 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:12.890870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 29/56] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:12.896863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:12.979889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:12.999520 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f0566-bdce-48b2-80a2-fe44ad58cd36 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:13.033237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb8b68-b397-42c9-8fda-d6bd82aa45dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:13.033841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb8b68-b397-42c9-8fda-d6bd82aa45dc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:13.034123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb8b68-b397-42c9-8fda-d6bd82aa45dc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:13.034398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb8b68-b397-42c9-8fda-d6bd82aa45dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:13.035121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb8b68-b397-42c9-8fda-d6bd82aa45dc None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.domain.id=default, user.id=0c35a81a1058405d92e858b7156195a3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:13.035450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb8b68-b397-42c9-8fda-d6bd82aa45dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:13.036891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb8b68-b397-42c9-8fda-d6bd82aa45dc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:13.042631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 10 07:57:12 2022] GET /identity/v3/role_assignments?user.id=0c35a81a1058405d92e858b7156195a3&scope.domain.id=default&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:14.568675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4fc54-5b00-4aa0-bbe2-578a87d5aadb None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:14.569166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4fc54-5b00-4aa0-bbe2-578a87d5aadb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:14.569166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4fc54-5b00-4aa0-bbe2-578a87d5aadb None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:14.570490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 30/58] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:14.575463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d059-0a39-4b4f-9f2f-cff1c00d131e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:14.575842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d059-0a39-4b4f-9f2f-cff1c00d131e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:14.576022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d059-0a39-4b4f-9f2f-cff1c00d131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:14.593621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5ad0d059-0a39-4b4f-9f2f-cff1c00d131e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:14.595043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5ad0d059-0a39-4b4f-9f2f-cff1c00d131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:14.658345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 29/59] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:14.682134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4fc54-5b00-4aa0-bbe2-578a87d5aadb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:14.783096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4fc54-5b00-4aa0-bbe2-578a87d5aadb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:14.816593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645cc24-2c2f-43f8-949e-7a82d658b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:14.817213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645cc24-2c2f-43f8-949e-7a82d658b1ef None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:14.817491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645cc24-2c2f-43f8-949e-7a82d658b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:14.817762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645cc24-2c2f-43f8-949e-7a82d658b1ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:14.818913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645cc24-2c2f-43f8-949e-7a82d658b1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:14.820329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645cc24-2c2f-43f8-949e-7a82d658b1ef None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:14.821876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 31/60] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:14.827436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d059-0a39-4b4f-9f2f-cff1c00d131e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:14.900731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:14.927380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d059-0a39-4b4f-9f2f-cff1c00d131e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:14.960173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372be27-8490-4837-a824-0ceb2daa2689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:14.960773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372be27-8490-4837-a824-0ceb2daa2689 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:14.961051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372be27-8490-4837-a824-0ceb2daa2689 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:14.961323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372be27-8490-4837-a824-0ceb2daa2689 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:14.961953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372be27-8490-4837-a824-0ceb2daa2689 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:14.963401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372be27-8490-4837-a824-0ceb2daa2689 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:14.989773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 30/61] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:57:14 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:18.198726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a14d6-1369-42ad-8754-97926e5f3107 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.199244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a14d6-1369-42ad-8754-97926e5f3107 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.199244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a14d6-1369-42ad-8754-97926e5f3107 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.200661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 32/62] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:18.206142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d8be-bd5a-47b7-a65a-fd7e47c0ff6d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.206564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d8be-bd5a-47b7-a65a-fd7e47c0ff6d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.206696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d8be-bd5a-47b7-a65a-fd7e47c0ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.229957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2683d8be-bd5a-47b7-a65a-fd7e47c0ff6d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:18.231526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2683d8be-bd5a-47b7-a65a-fd7e47c0ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:18.231642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0e171-a5df-492e-ad14-ec3ed16416fd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.232019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0e171-a5df-492e-ad14-ec3ed16416fd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.232401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0e171-a5df-492e-ad14-ec3ed16416fd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.233909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 33/63] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:18.240142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ba83-ff5f-4a77-a766-64abb2369cf4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.240427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ba83-ff5f-4a77-a766-64abb2369cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.240690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ba83-ff5f-4a77-a766-64abb2369cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.271759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-aff2ba83-ff5f-4a77-a766-64abb2369cf4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:18.272965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-aff2ba83-ff5f-4a77-a766-64abb2369cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:18.337075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 31/64] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:18.363790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:18.389217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683d8be-bd5a-47b7-a65a-fd7e47c0ff6d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:18.399494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 34/65] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:18.400963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476246-ba74-42a6-ba76-09d53beb9d28 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.401425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476246-ba74-42a6-ba76-09d53beb9d28 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.401843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476246-ba74-42a6-ba76-09d53beb9d28 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.403258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 35/66] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:18.412880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cd71d-62ef-4959-8306-84f517dbf283 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.413898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cd71d-62ef-4959-8306-84f517dbf283 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.416096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cd71d-62ef-4959-8306-84f517dbf283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.441437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1e1cd71d-62ef-4959-8306-84f517dbf283 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:18.443320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1e1cd71d-62ef-4959-8306-84f517dbf283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:18.474885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:18.523024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 36/67] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:18.528530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cd71d-62ef-4959-8306-84f517dbf283 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:18.541893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683d8be-bd5a-47b7-a65a-fd7e47c0ff6d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:18.582535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:18.583269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.583586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.583861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.595301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:18.600039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:18.600970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:18.601730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 32/68] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:18.602356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:18.648783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cd71d-62ef-4959-8306-84f517dbf283 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:18.659192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:18.686559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570098a-3d13-450f-9cad-1b243fe1b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:18.688069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570098a-3d13-450f-9cad-1b243fe1b037 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.688580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570098a-3d13-450f-9cad-1b243fe1b037 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.688921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570098a-3d13-450f-9cad-1b243fe1b037 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.700006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570098a-3d13-450f-9cad-1b243fe1b037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1570098a-3d13-450f-9cad-1b243fe1b037 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:18.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:18.706302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:18.707100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:18.711229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 37/69] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:18.712745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5878ec-007c-4feb-b5a9-6d6a905117c2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.713031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5878ec-007c-4feb-b5a9-6d6a905117c2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.713306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5878ec-007c-4feb-b5a9-6d6a905117c2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.714586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 38/70] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:18.715534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5878ec-007c-4feb-b5a9-6d6a905117c2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:18.721341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804e5c2-e049-4551-9df1-d3e19ecc6e55 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:18.742846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:18.757766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:18.758403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.758684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.759020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.769720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:18.774462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:18.775477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 33/71] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:18.776460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:18.828818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5878ec-007c-4feb-b5a9-6d6a905117c2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:18.862085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578e700-6b32-4b93-b2c5-599130b7feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:18.862682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e700-6b32-4b93-b2c5-599130b7feeb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.862955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e700-6b32-4b93-b2c5-599130b7feeb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.863222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e700-6b32-4b93-b2c5-599130b7feeb None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.863905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578e700-6b32-4b93-b2c5-599130b7feeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:18.864203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578e700-6b32-4b93-b2c5-599130b7feeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:18.865585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578e700-6b32-4b93-b2c5-599130b7feeb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:18.873387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 39/72] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:18.874504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cde8-8992-4160-a9ea-ae99ae18659f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.874787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cde8-8992-4160-a9ea-ae99ae18659f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.875612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cde8-8992-4160-a9ea-ae99ae18659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.883200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426cd78-99a6-4dfd-bbe7-c13f7705b5f2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:18.894272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3545cde8-8992-4160-a9ea-ae99ae18659f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:18.895478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3545cde8-8992-4160-a9ea-ae99ae18659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:18.917935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375777d-8bf6-4d45-98c2-281a7b550542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:18.918543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375777d-8bf6-4d45-98c2-281a7b550542 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.918710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:18.918848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375777d-8bf6-4d45-98c2-281a7b550542 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.919099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375777d-8bf6-4d45-98c2-281a7b550542 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.919940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375777d-8bf6-4d45-98c2-281a7b550542 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:18.920250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375777d-8bf6-4d45-98c2-281a7b550542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:18.921731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375777d-8bf6-4d45-98c2-281a7b550542 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:18.936902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 34/73] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:18.936902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee8d6-a676-486f-8f86-080b7357edcf None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:18.936902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee8d6-a676-486f-8f86-080b7357edcf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:18.936902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee8d6-a676-486f-8f86-080b7357edcf None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:18.936902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 35/74] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:18.936902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee8d6-a676-486f-8f86-080b7357edcf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:18.965117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 40/75] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:18.966006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545cde8-8992-4160-a9ea-ae99ae18659f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:18.978940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.039290 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee8d6-a676-486f-8f86-080b7357edcf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.070131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545cde8-8992-4160-a9ea-ae99ae18659f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.073831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.074435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.074718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.075001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.075694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:19.076000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.077393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.086425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 36/76] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:19.087216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.108327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814f142-fced-4f0e-9def-8b2ccd5c9467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.109194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f142-fced-4f0e-9def-8b2ccd5c9467 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.109998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f142-fced-4f0e-9def-8b2ccd5c9467 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.110652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f142-fced-4f0e-9def-8b2ccd5c9467 None admin] PATH_INFO: `/v3/users/0c35a81a1058405d92e858b7156195a3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.111687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814f142-fced-4f0e-9def-8b2ccd5c9467 None admin] RBAC: Authorizing `identity:get_user(user_id=0c35a81a1058405d92e858b7156195a3)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.113177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814f142-fced-4f0e-9def-8b2ccd5c9467 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.118736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 41/77] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:18 2022] GET /identity/v3/users/0c35a81a1058405d92e858b7156195a3 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:19.118736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b10ce-20fe-4ef5-98a1-75dff0df227c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.118736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b10ce-20fe-4ef5-98a1-75dff0df227c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.118736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b10ce-20fe-4ef5-98a1-75dff0df227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.134052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a94b10ce-20fe-4ef5-98a1-75dff0df227c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:19.135224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a94b10ce-20fe-4ef5-98a1-75dff0df227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:19.157143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.191202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4461fa-63cb-42cb-89ff-3d972d80ddb8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.193485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.201030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 42/78] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:19.201948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b10ce-20fe-4ef5-98a1-75dff0df227c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.226218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.226943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.227291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.227677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.241540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.243006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.244642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 37/79] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:19.245406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.305808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b10ce-20fe-4ef5-98a1-75dff0df227c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.339029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.339677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.339955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.340222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.347426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e81c7-9a3b-4381-9020-e33834fe76a1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.350495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:19.355177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:19.356131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:19.356934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 43/80] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:19.357567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.377319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.385257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.385892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.386233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.386444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.387629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.389154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.390661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 38/81] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:19.391443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.421402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.459882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876fcd-ac50-45de-8254-c7e254e4d3bf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.491651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966920-ec36-41b1-aa1e-60f37f21fb99 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.493745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.494348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.494628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.494901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.524673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.525304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.525583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.525857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.526952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.528453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.530009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 39/82] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:19.535307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.560982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.562393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.579286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.628427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.632338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce916af-2879-44d8-9aca-822c5f99c4b9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.661175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 44/83] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:19.664297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.665979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.666589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.666868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.667141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.734289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.735996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.761911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173889c7-4442-45d1-bcc5-ba12302f6e80 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.782861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.799836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.800457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.800734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.801015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.801676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:19.801979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.803343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.811745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 45/84] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:19.812505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.834273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.838919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 40/85] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:19.840559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:19.912888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e73ca1-fa49-49fa-97ec-ef0b8cc58c11 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.939291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30a6b6-1678-4248-9f27-c3e17b4b2555 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:19.945027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.945631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.945908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.946176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.973567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:19.974174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:19.974457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:19.974733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:19.975386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:19.976877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:19.993625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:19.998188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 41/86] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:57:19 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:20.004671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.017704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.019777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.073264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:20.131569 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667dff-4b28-40d0-b952-d76988d1662a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.133278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 46/87] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:20.134134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.179850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:20.180496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.181211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.181490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.182999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.185089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.186905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 42/88] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:19 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:20.188134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.238252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:20.267991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b1a9-3900-491d-8629-c339437b74e1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.318559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:20.319192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.319515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.319811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.320919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.322145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb49a-6d76-4116-9ddb-1fa1c21a06ae None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.322579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.324302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 47/89] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:20.325023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.354128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:20.373225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:20.376321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.376655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.376937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.380179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.382437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.385272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 43/90] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:20.386667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.450169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2b2a0-210e-43e6-a2fd-05b24022523d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.488425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:20.489055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.489341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.489618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.490758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.492241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.494108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 48/91] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:20.499462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.513040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5ec01-4bba-4930-af8d-27fd98634454 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.521559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:20.568817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:20.570223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.570743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.571206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.572161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=0c35a81a1058405d92e858b7156195a3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:20.573198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.575443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.585016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 44/92] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/role_assignments?user.id=0c35a81a1058405d92e858b7156195a3&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:20.586370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.644923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595fbb-67da-412d-8040-6f49903f7c82 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.688320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:20.689275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.689725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.690792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.739867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:20.782710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.784527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.815267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:20.851732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006465-bb62-4638-8cf2-0d232ff2b248 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:20.915329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:20.916264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:20.916742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:20.917180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:20.918133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:20.918609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:20.920252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:20.932334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 45/93] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/role_assignments?user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=e606be389f29465393427b1abb34b098 => generated 259 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:20.934393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:20.967398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 49/94] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:20.974674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:21.133193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fad49c-d668-485d-8f00-5720411f987a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:21.164667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ffb1d-1829-4603-a77c-87adc5cd530c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:21.167211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:21.185566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:21.199769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b3565-c5ec-49dd-975f-350f0e4fe65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:21.200594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b3565-c5ec-49dd-975f-350f0e4fe65d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:21.200957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b3565-c5ec-49dd-975f-350f0e4fe65d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:21.201327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b3565-c5ec-49dd-975f-350f0e4fe65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:21.202293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b3565-c5ec-49dd-975f-350f0e4fe65d None admin] RBAC: Adding query filter params (role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:21.202693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b3565-c5ec-49dd-975f-350f0e4fe65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:21.204763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b3565-c5ec-49dd-975f-350f0e4fe65d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:21.207626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:21.208497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:21.208934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:21.209359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] PATH_INFO: `/v3/projects/eb643c703dee4be5b0d7875e83bc25a5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:21.213286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] RBAC: Authorizing `identity:get_project(project_id=eb643c703dee4be5b0d7875e83bc25a5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:21.214986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:21.217179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 50/95] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/projects/eb643c703dee4be5b0d7875e83bc25a5 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:21.220964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 46/96] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:20 2022] GET /identity/v3/role_assignments?user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:21.226765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:21.343657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951d607-17b7-40be-b587-215c36e0962c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:21.381408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28937901-be7f-49f9-918b-436b4326c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:21.382375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937901-be7f-49f9-918b-436b4326c1ad None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:21.382823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937901-be7f-49f9-918b-436b4326c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:21.383319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937901-be7f-49f9-918b-436b4326c1ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:21.384270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28937901-be7f-49f9-918b-436b4326c1ad None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, scope.project.id=eb643c703dee4be5b0d7875e83bc25a5, user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:21.384773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28937901-be7f-49f9-918b-436b4326c1ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:21.386417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28937901-be7f-49f9-918b-436b4326c1ad None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:21.396830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 51/97] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:21 2022] GET /identity/v3/role_assignments?user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9&scope.project.id=eb643c703dee4be5b0d7875e83bc25a5&role.id=e606be389f29465393427b1abb34b098 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:22.755395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cab67-46a1-45e1-86c2-6ebeac0bea7a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:22.755917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cab67-46a1-45e1-86c2-6ebeac0bea7a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:22.755917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cab67-46a1-45e1-86c2-6ebeac0bea7a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:22.757297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 47/98] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:22.762678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8892-0fbf-44bc-8d53-f83a318f682d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:22.763098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8892-0fbf-44bc-8d53-f83a318f682d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:22.763277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8892-0fbf-44bc-8d53-f83a318f682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:22.783107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dc5c8892-0fbf-44bc-8d53-f83a318f682d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:22.784353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dc5c8892-0fbf-44bc-8d53-f83a318f682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:22.858932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:22.891367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 52/99] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:22.926835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cab67-46a1-45e1-86c2-6ebeac0bea7a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:23.038664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cab67-46a1-45e1-86c2-6ebeac0bea7a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:23.085009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57679d9-80f7-470d-86df-3114edcb35ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:23.085639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57679d9-80f7-470d-86df-3114edcb35ba None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.085921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57679d9-80f7-470d-86df-3114edcb35ba None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.086195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57679d9-80f7-470d-86df-3114edcb35ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.087307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57679d9-80f7-470d-86df-3114edcb35ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:23.088799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57679d9-80f7-470d-86df-3114edcb35ba None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:23.090414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 48/100] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:23.096189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8892-0fbf-44bc-8d53-f83a318f682d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:23.220625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8892-0fbf-44bc-8d53-f83a318f682d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:23.267192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:23.267874 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.268159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.268436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.269095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:23.270597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:23.311738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666728b8-6ff8-45f5-9b72-c0f89b7b0297 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.312054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666728b8-6ff8-45f5-9b72-c0f89b7b0297 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.312420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666728b8-6ff8-45f5-9b72-c0f89b7b0297 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.314321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 49/101] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:23.319745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3104-df18-4943-b084-b4027fff16d7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.320072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3104-df18-4943-b084-b4027fff16d7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.320355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3104-df18-4943-b084-b4027fff16d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.333088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 53/102] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:57:23 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:23.351322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-18de3104-df18-4943-b084-b4027fff16d7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:23.352733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-18de3104-df18-4943-b084-b4027fff16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:23.414929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:23.439736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 50/103] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:23.477750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:23.481320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbd38-3bc7-4041-8e36-ab31c47804b1 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.481608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbd38-3bc7-4041-8e36-ab31c47804b1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.481881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbd38-3bc7-4041-8e36-ab31c47804b1 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.484239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 51/104] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:23.490654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa322f-f322-4347-bff0-122f5c8648aa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.490944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa322f-f322-4347-bff0-122f5c8648aa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.491200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa322f-f322-4347-bff0-122f5c8648aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.521131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-60aa322f-f322-4347-bff0-122f5c8648aa None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:23.522325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-60aa322f-f322-4347-bff0-122f5c8648aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:23.543798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:23.665633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 52/105] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:23.682958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce627-08ef-4d6a-a894-5f5f1a4f067a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:23.698567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa322f-f322-4347-bff0-122f5c8648aa None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:23.748127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:23.749147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.749643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.749947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.780363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:23.786100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:23.786963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:23.787785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 54/106] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:23.793999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:23.845314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa322f-f322-4347-bff0-122f5c8648aa None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:23.858395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:23.888586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:23.889508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:23.889986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:23.890475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:23.903808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:23.909523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:23.910391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:23.911163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:23.913329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 53/107] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:23.920174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.017472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.040646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309fe16-2468-4f60-ab14-62269c7598c4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.062732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db72aa-bcd8-4e33-9081-3a2c2b52ccd7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.113500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22fe20-4bda-43e3-8935-eb5e864cf335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.115328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fe20-4bda-43e3-8935-eb5e864cf335 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.115640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fe20-4bda-43e3-8935-eb5e864cf335 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.115921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fe20-4bda-43e3-8935-eb5e864cf335 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.116602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22fe20-4bda-43e3-8935-eb5e864cf335 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:24.116909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22fe20-4bda-43e3-8935-eb5e864cf335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.119144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22fe20-4bda-43e3-8935-eb5e864cf335 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.132847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5adba8-ff93-4230-9060-e21d699224f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.133531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5adba8-ff93-4230-9060-e21d699224f8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.133813 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5adba8-ff93-4230-9060-e21d699224f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5adba8-ff93-4230-9060-e21d699224f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.136046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5adba8-ff93-4230-9060-e21d699224f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:24.136358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5adba8-ff93-4230-9060-e21d699224f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.137781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5adba8-ff93-4230-9060-e21d699224f8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.140492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 55/108] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:24.142870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768d53c-f675-48ad-ba43-6e54e4a347a8 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.143157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768d53c-f675-48ad-ba43-6e54e4a347a8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.143462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768d53c-f675-48ad-ba43-6e54e4a347a8 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.144756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 56/109] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:24.146612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768d53c-f675-48ad-ba43-6e54e4a347a8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.160626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 54/110] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:24.162188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5108da-15ac-445b-91f6-6bf83981f4d4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.165205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5108da-15ac-445b-91f6-6bf83981f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.165689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5108da-15ac-445b-91f6-6bf83981f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.205437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9c5108da-15ac-445b-91f6-6bf83981f4d4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:24.207955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9c5108da-15ac-445b-91f6-6bf83981f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:24.254585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.308049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 55/111] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:24.308049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5108da-15ac-445b-91f6-6bf83981f4d4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.308204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768d53c-f675-48ad-ba43-6e54e4a347a8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.345687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e910dc-f8af-49b6-952e-01c91f62b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.346334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e910dc-f8af-49b6-952e-01c91f62b899 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.346620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e910dc-f8af-49b6-952e-01c91f62b899 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.346900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e910dc-f8af-49b6-952e-01c91f62b899 None admin] PATH_INFO: `/v3/users/c646d3eec3524ef08f972dd476cdde60` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.367404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e910dc-f8af-49b6-952e-01c91f62b899 None admin] RBAC: Authorizing `identity:get_user(user_id=c646d3eec3524ef08f972dd476cdde60)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.369748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e910dc-f8af-49b6-952e-01c91f62b899 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.371680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 57/112] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:24 2022] GET /identity/v3/users/c646d3eec3524ef08f972dd476cdde60 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:24.372731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193aea-396b-4562-b6b8-9e5af4b2eba3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.373014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193aea-396b-4562-b6b8-9e5af4b2eba3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.373292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193aea-396b-4562-b6b8-9e5af4b2eba3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.375012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 58/113] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:24.376112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193aea-396b-4562-b6b8-9e5af4b2eba3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.391924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.451985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5108da-15ac-445b-91f6-6bf83981f4d4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.499514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193aea-396b-4562-b6b8-9e5af4b2eba3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.500270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300b4a3-0dd7-49a0-a0c2-9210be8aec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.501245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b4a3-0dd7-49a0-a0c2-9210be8aec43 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.501600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b4a3-0dd7-49a0-a0c2-9210be8aec43 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.502033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b4a3-0dd7-49a0-a0c2-9210be8aec43 None admin] PATH_INFO: `/v3/users/0c35a81a1058405d92e858b7156195a3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.503211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300b4a3-0dd7-49a0-a0c2-9210be8aec43 None admin] RBAC: Authorizing `identity:get_user(user_id=0c35a81a1058405d92e858b7156195a3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.504727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300b4a3-0dd7-49a0-a0c2-9210be8aec43 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.506335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 56/114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:24 2022] GET /identity/v3/users/0c35a81a1058405d92e858b7156195a3 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:24.507485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e1e6-3836-4e16-b252-1bfc28d4c549 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.507771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e1e6-3836-4e16-b252-1bfc28d4c549 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.508046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e1e6-3836-4e16-b252-1bfc28d4c549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.526521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d9e4e1e6-3836-4e16-b252-1bfc28d4c549 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:24.527744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d9e4e1e6-3836-4e16-b252-1bfc28d4c549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:24.540941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.541578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.541851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.542133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.553543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.553791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:24.558653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:24.560033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:24.560828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 59/115] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:24.566290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.611439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 57/116] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:24.611439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4e1e6-3836-4e16-b252-1bfc28d4c549 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.643006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.676767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223508-de6d-4c57-8b6b-15ceb0705783 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.714243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.714855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.715133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.715405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.723776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4e1e6-3836-4e16-b252-1bfc28d4c549 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.759150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b315c-ff14-4503-810f-b9e7908de11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.759736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b315c-ff14-4503-810f-b9e7908de11e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.760019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b315c-ff14-4503-810f-b9e7908de11e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.760296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b315c-ff14-4503-810f-b9e7908de11e None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.761418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b315c-ff14-4503-810f-b9e7908de11e None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.762864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b315c-ff14-4503-810f-b9e7908de11e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.764679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 58/117] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:24 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:24.765847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74af02-eddd-4108-ad68-eae033940a91 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.766167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74af02-eddd-4108-ad68-eae033940a91 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.766443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74af02-eddd-4108-ad68-eae033940a91 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.771674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 59/118] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:24.771674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74af02-eddd-4108-ad68-eae033940a91 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.796935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.798425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.802288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.873626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:24.883758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74af02-eddd-4108-ad68-eae033940a91 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:24.907145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 60/119] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:24.912509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:24.924022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:24.924836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:24.924943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:24.925258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:24.925992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:24.926229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:24.927628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:24.941430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 60/120] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:24.941430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.029442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8620555-cded-4c08-ae88-5a40f022f999 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.051611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.062892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc35e-f9db-43a7-a946-eefba04c361e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.070318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0640d-9119-44ba-8751-fa4d515ffe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.070965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0640d-9119-44ba-8751-fa4d515ffe67 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.071247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0640d-9119-44ba-8751-fa4d515ffe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.071548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0640d-9119-44ba-8751-fa4d515ffe67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.086270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0640d-9119-44ba-8751-fa4d515ffe67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-05f0640d-9119-44ba-8751-fa4d515ffe67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:25.093159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:25.094111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:25.094986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 61/121] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:25.096328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4786897-cb14-498a-bb90-ae418db112d3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.096328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4786897-cb14-498a-bb90-ae418db112d3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.096567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4786897-cb14-498a-bb90-ae418db112d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.102224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.102894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.103172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.103519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41/users/0c35a81a1058405d92e858b7156195a3/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.105460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6e651f72afb4d498852b26955899a41, user_id=0c35a81a1058405d92e858b7156195a3, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.106929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.118188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c4786897-cb14-498a-bb90-ae418db112d3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:25.119437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c4786897-cb14-498a-bb90-ae418db112d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:25.120930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 61/122] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:24 2022] PUT /identity/v3/projects/e6e651f72afb4d498852b26955899a41/users/0c35a81a1058405d92e858b7156195a3/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:57:25.121515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.157476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.225750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 62/123] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:25.231346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4786897-cb14-498a-bb90-ae418db112d3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.264653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d47f-eb29-41bb-985d-ea66fe533ad6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.316567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.317353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.317862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.318575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.320129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.321929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.324308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 62/124] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:25.325174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.351644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.376972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4786897-cb14-498a-bb90-ae418db112d3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.425688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.427110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.427681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.428101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.429675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.432053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.434744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 63/125] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:25.441617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.454788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405c1a-2b4c-4c88-be80-94a634a9c6aa None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.480029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.495510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.496119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.496397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.496665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.497333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:25.497631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.499120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.509551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 63/126] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:25.510415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.576691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad2f7-3cf5-4a42-a82e-85f1638ee274 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.613325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.613856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.614137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.614465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.616865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.626813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:25.632259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:25.633334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:25.634301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:25.640883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 64/127] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:25.641973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.643802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d346c9c-cadf-4c8c-ac1c-aada9d1c7d65 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.692886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.694014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.694443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.695291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.696238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] RBAC: Adding query filter params (role.id=918555c720174958942568d7b3913066, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=c646d3eec3524ef08f972dd476cdde60) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:25.696694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.698876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.707497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 64/128] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/role_assignments?user.id=c646d3eec3524ef08f972dd476cdde60&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=918555c720174958942568d7b3913066 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:25.708630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.762492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:25.779264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265f330-0827-4a05-8f01-01f586535a81 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.826006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.829394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.829394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.829859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.832124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.833704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.835526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 65/129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:25.839587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.916106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de17fa-fb87-423b-a6cf-54ff0e9b5715 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.960583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:25.961241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:25.961658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:25.961974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:25.963584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:25.965312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:25.966972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 65/130] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:25.971757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:25.988545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074abe46-62b5-475b-87f2-edd518394bf6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:25.995800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:26.027864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9807-38d9-4f09-9ee2-f24f488a54b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.028804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9807-38d9-4f09-9ee2-f24f488a54b0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.029305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9807-38d9-4f09-9ee2-f24f488a54b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.030337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9807-38d9-4f09-9ee2-f24f488a54b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.031251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9807-38d9-4f09-9ee2-f24f488a54b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:26.032381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9807-38d9-4f09-9ee2-f24f488a54b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.034669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9807-38d9-4f09-9ee2-f24f488a54b0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.047536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 66/131] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:26.049255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca121-fb96-447c-938c-284c7f4fe11d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.049794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca121-fb96-447c-938c-284c7f4fe11d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.050313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca121-fb96-447c-938c-284c7f4fe11d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.052126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 67/132] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:26.055492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca121-fb96-447c-938c-284c7f4fe11d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:26.079979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:26.115210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70917-6228-4b19-a587-901ebcd4f263 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.153320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.154389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.154867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.155338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.158306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6e651f72afb4d498852b26955899a41, user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.160020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.177690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 66/133] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:25 2022] PUT /identity/v3/projects/e6e651f72afb4d498852b26955899a41/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:57:26.178920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:26.201270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca121-fb96-447c-938c-284c7f4fe11d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.254298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48ea9d-ad4a-4289-828c-2d6ccdbda3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.254969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ea9d-ad4a-4289-828c-2d6ccdbda3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.255247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ea9d-ad4a-4289-828c-2d6ccdbda3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.255549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ea9d-ad4a-4289-828c-2d6ccdbda3b5 None admin] PATH_INFO: `/v3/projects/eb643c703dee4be5b0d7875e83bc25a5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.257065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48ea9d-ad4a-4289-828c-2d6ccdbda3b5 None admin] RBAC: Authorizing `identity:get_project(project_id=eb643c703dee4be5b0d7875e83bc25a5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.259541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48ea9d-ad4a-4289-828c-2d6ccdbda3b5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.261696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 68/134] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:26 2022] GET /identity/v3/projects/eb643c703dee4be5b0d7875e83bc25a5 => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:26.266346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:26.266516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef504e36-8bd6-4027-a1be-d98544516a03 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.266516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef504e36-8bd6-4027-a1be-d98544516a03 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.266516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef504e36-8bd6-4027-a1be-d98544516a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.299540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ef504e36-8bd6-4027-a1be-d98544516a03 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:26.307534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ef504e36-8bd6-4027-a1be-d98544516a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:26.333938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637df7-d147-499b-8732-8826588a6045 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.391898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 69/135] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:26.392737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef504e36-8bd6-4027-a1be-d98544516a03 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:26.412778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:26.432156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.433123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.433401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.433684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.435136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.436647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.439043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 67/136] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:26 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:26.439571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:26.516169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef504e36-8bd6-4027-a1be-d98544516a03 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.563211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.564013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.564367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.564717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] PATH_INFO: `/v3/projects/eb643c703dee4be5b0d7875e83bc25a5/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.566839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] RBAC: Authorizing `identity:create_grant(project_id=eb643c703dee4be5b0d7875e83bc25a5, user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.568474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.579661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa303e-b690-4de6-bae9-8769119c29ca None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.587310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 70/137] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:26 2022] PUT /identity/v3/projects/eb643c703dee4be5b0d7875e83bc25a5/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:57:26.589104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:26.622496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.623524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.624066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.624560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.626862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.628628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.630449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 68/138] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:26.636621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:26.651480 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:26.691604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:26.753661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b27dab-a4cf-4e05-9124-09bb15179b4e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.774370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe0b03-f1f6-47da-baef-6d2a11f4b766 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.810280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.811125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.811571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.812814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.813827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.815450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.817477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 71/139] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:26 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:26.822034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354e580-a743-4557-8dc6-5d8594be0c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.822913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e580-a743-4557-8dc6-5d8594be0c5d None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.823151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:26.823513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e580-a743-4557-8dc6-5d8594be0c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.824039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e580-a743-4557-8dc6-5d8594be0c5d None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.824850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354e580-a743-4557-8dc6-5d8594be0c5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.826879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354e580-a743-4557-8dc6-5d8594be0c5d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:26.860978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 69/140] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:57:26 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:26.951073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1bc02-1af8-4460-8c9f-fd31aa4f6cee None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:26.994611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a803f4-f24d-486e-b338-cf384ea3b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:26.995280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a803f4-f24d-486e-b338-cf384ea3b1ed None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:26.995590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a803f4-f24d-486e-b338-cf384ea3b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:26.995864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a803f4-f24d-486e-b338-cf384ea3b1ed None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:26.998054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a803f4-f24d-486e-b338-cf384ea3b1ed None admin] RBAC: Authorizing `identity:create_grant(project_id=e6e651f72afb4d498852b26955899a41, user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9, role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:26.999548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a803f4-f24d-486e-b338-cf384ea3b1ed None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:27.015435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 72/141] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:26 2022] PUT /identity/v3/projects/e6e651f72afb4d498852b26955899a41/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9/roles/d4924cc22b334ebe9f07b5938e64913b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:57:27.514180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdbb87-9ae3-4012-9dad-2419f650dfaf None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:27.514692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdbb87-9ae3-4012-9dad-2419f650dfaf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:27.514768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdbb87-9ae3-4012-9dad-2419f650dfaf None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:27.516910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 70/142] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:27.521924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517cbb-953f-4fd3-8fbd-0dc62cb9b527 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:27.522208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517cbb-953f-4fd3-8fbd-0dc62cb9b527 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:27.522486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517cbb-953f-4fd3-8fbd-0dc62cb9b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:27.536199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:27.556376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-62517cbb-953f-4fd3-8fbd-0dc62cb9b527 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:27.557491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-62517cbb-953f-4fd3-8fbd-0dc62cb9b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:27.651308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 73/143] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:27.683091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdbb87-9ae3-4012-9dad-2419f650dfaf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:27.777324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:27.826211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdbb87-9ae3-4012-9dad-2419f650dfaf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:27.863226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:27.863889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:27.864170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:27.864443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:27.878256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:27.883445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:27.884312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:27.885094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 71/144] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:27.891063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517cbb-953f-4fd3-8fbd-0dc62cb9b527 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:28.034937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517cbb-953f-4fd3-8fbd-0dc62cb9b527 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:28.079706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:28.080247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.080524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.080794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.081467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:28.081761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:28.083148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:28.084694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:28.096218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 74/145] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:28.101626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:28.241003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e987396-c648-42a8-9562-266cf6fee708 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:28.273784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:28.286673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:28.287310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.287612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.287887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] PATH_INFO: `/v3/users/0c35a81a1058405d92e858b7156195a3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.289033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=0c35a81a1058405d92e858b7156195a3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:28.290521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:28.295524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 72/146] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:28 2022] GET /identity/v3/users/0c35a81a1058405d92e858b7156195a3 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:28.297627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:28.445731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af44f-2275-4f73-b797-23848bf04cbe None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:28.487320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb524b9e-0ab6-4745-a570-1e2143fc1e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:28.487953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb524b9e-0ab6-4745-a570-1e2143fc1e3e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.488229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb524b9e-0ab6-4745-a570-1e2143fc1e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.488499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb524b9e-0ab6-4745-a570-1e2143fc1e3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.570253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:28.579567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb524b9e-0ab6-4745-a570-1e2143fc1e3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:28.581047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb524b9e-0ab6-4745-a570-1e2143fc1e3e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:28.689171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 75/147] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:28.700603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:28.831732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d9277-f864-49ec-9209-8f78992914b5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.832070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d9277-f864-49ec-9209-8f78992914b5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.832414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d9277-f864-49ec-9209-8f78992914b5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.834207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 76/148] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:28.845242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbb5e5-559b-49a3-bf3b-c482c42a2ae7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:28.847919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed852-a8fd-4680-826f-39dc90ab904e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.848199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed852-a8fd-4680-826f-39dc90ab904e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.848467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed852-a8fd-4680-826f-39dc90ab904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.884877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ecbed852-a8fd-4680-826f-39dc90ab904e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:28.886195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ecbed852-a8fd-4680-826f-39dc90ab904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:28.907755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:28.908724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:28.909193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:28.909647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:28.910980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:28.912668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:28.914530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 73/149] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:28 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:28.944177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:29.046050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 77/150] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:29.087661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:29.099798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbed852-a8fd-4680-826f-39dc90ab904e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:29.168442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453486f-b91b-4adf-a7af-6ebbad4a3003 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:29.170592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:29.252177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:29.252807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.253101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.253356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.254094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=0c35a81a1058405d92e858b7156195a3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:29.254401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:29.255896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:29.274041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 74/151] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:28 2022] GET /identity/v3/role_assignments?user.id=0c35a81a1058405d92e858b7156195a3&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:29.350500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbed852-a8fd-4680-826f-39dc90ab904e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:29.406459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1b9fb-cbe4-4c01-8346-02f616130a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:29.407118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1b9fb-cbe4-4c01-8346-02f616130a30 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.407396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1b9fb-cbe4-4c01-8346-02f616130a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.407692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1b9fb-cbe4-4c01-8346-02f616130a30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.428390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1b9fb-cbe4-4c01-8346-02f616130a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1cf1b9fb-cbe4-4c01-8346-02f616130a30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:29.433657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:29.434891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:29.435737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 78/152] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:29.443126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:29.597521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b4a1f-8773-4275-a3f9-40a885114079 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.597706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b4a1f-8773-4275-a3f9-40a885114079 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.597975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b4a1f-8773-4275-a3f9-40a885114079 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.599324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 79/153] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:29.620667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c19b3-32fc-4af5-972a-38686591dc3e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.620993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c19b3-32fc-4af5-972a-38686591dc3e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.621216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c19b3-32fc-4af5-972a-38686591dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.644934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01947d-1fb2-4240-8d85-c51619adc1f9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:29.648766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-047c19b3-32fc-4af5-972a-38686591dc3e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:29.648766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-047c19b3-32fc-4af5-972a-38686591dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:29.687424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:29.708109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:29.708758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.708983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.709258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.709930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:29.710230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:29.711648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:29.737363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 75/154] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:29.742994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:29.763536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 80/155] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:29.798545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c19b3-32fc-4af5-972a-38686591dc3e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:29.825954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:29.928408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad41ed-ab14-4ffd-9b2d-a36d10c3a32f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:29.948259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c19b3-32fc-4af5-972a-38686591dc3e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:29.975797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:29.976693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.977131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.977540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] PATH_INFO: `/v3/users/c646d3eec3524ef08f972dd476cdde60` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.978895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] RBAC: Authorizing `identity:get_user(user_id=c646d3eec3524ef08f972dd476cdde60)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:29.980615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:29.988499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 76/156] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:29 2022] GET /identity/v3/users/c646d3eec3524ef08f972dd476cdde60 => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:29.989986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:29.990635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:29.990918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:29.991232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:29.994348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:30.003723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:30.008706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:30.009977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:30.011022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 81/157] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:30.019334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:30.082835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:30.123825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:30.164464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213f2fb-2f16-4468-8698-2abad62bd7ec None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:30.177259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8114e0-7d63-4f60-9bf3-b543fabd6251 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:30.219775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:30.220381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.220661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.220937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.221661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:30.221967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:30.225756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:30.239255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 82/158] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:30.247019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:30.266105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:30.267133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.267689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.268176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.269534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:30.271019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:30.273001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 77/159] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:29 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:30.278600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:30.412220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199887c-ecc4-45c9-9bc9-3347d273e224 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:30.416443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e43f-2c39-4001-b9ce-8120922b6627 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:30.446466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:30.452174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:30.453737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.454289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.454667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41/users/c646d3eec3524ef08f972dd476cdde60/roles/918555c720174958942568d7b3913066` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.456769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] RBAC: Authorizing `identity:create_grant(project_id=e6e651f72afb4d498852b26955899a41, user_id=c646d3eec3524ef08f972dd476cdde60, role_id=918555c720174958942568d7b3913066)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:30.458334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:30.472558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:30.473489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.474228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.474641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.476074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:30.477690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:30.479914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 83/160] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:30 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:30.483257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 78/161] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:30 2022] PUT /identity/v3/projects/e6e651f72afb4d498852b26955899a41/users/c646d3eec3524ef08f972dd476cdde60/roles/918555c720174958942568d7b3913066 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:57:30.488136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:30.499885 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:30.620257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c1ee-9edf-43be-b341-d92dfe611714 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:30.657881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c937f2d-b823-4983-98f6-3ad09a85cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:30.658504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937f2d-b823-4983-98f6-3ad09a85cb10 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.658784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937f2d-b823-4983-98f6-3ad09a85cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.659061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937f2d-b823-4983-98f6-3ad09a85cb10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.733104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c937f2d-b823-4983-98f6-3ad09a85cb10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:30.735114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c937f2d-b823-4983-98f6-3ad09a85cb10 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:30.759819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:30.846142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 84/162] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:30.851631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:30.868686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e88d6-7afa-47d8-83b9-195930cb537e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.869004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e88d6-7afa-47d8-83b9-195930cb537e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.869249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e88d6-7afa-47d8-83b9-195930cb537e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.871386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 85/163] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:30.881826 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a0f8-a73f-4318-93e4-38a068af7447 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:30.882143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a0f8-a73f-4318-93e4-38a068af7447 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:30.882375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a0f8-a73f-4318-93e4-38a068af7447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:30.909499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4150a0f8-a73f-4318-93e4-38a068af7447 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:30.910486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4150a0f8-a73f-4318-93e4-38a068af7447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:30.974408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba51ee-5e92-40c9-bef3-4243082cff9e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:31.012119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:31.012427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 86/164] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:31.013289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.013889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.014393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.016797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:31.018534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:31.020515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 79/165] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:30 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:31.027493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150a0f8-a73f-4318-93e4-38a068af7447 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.053903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.082254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.144083 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.215573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624197-0d84-420e-82bf-f1977ada70f4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:31.244028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150a0f8-a73f-4318-93e4-38a068af7447 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:31.256319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d12899-7add-47f7-84a6-dc1506c034db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:31.257315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12899-7add-47f7-84a6-dc1506c034db None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.257895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12899-7add-47f7-84a6-dc1506c034db None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.258379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12899-7add-47f7-84a6-dc1506c034db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.269717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d12899-7add-47f7-84a6-dc1506c034db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-69d12899-7add-47f7-84a6-dc1506c034db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:31.275539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:31.276446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:31.277509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:31.283895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 80/166] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:31.285478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f470b-21d8-4fb9-b423-b93f542dc8ae None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.285979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f470b-21d8-4fb9-b423-b93f542dc8ae None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.286489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f470b-21d8-4fb9-b423-b93f542dc8ae None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.288036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 81/167] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:31.293413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5ecf5-abec-49f3-b876-e4412965adb1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.293944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5ecf5-abec-49f3-b876-e4412965adb1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.294415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5ecf5-abec-49f3-b876-e4412965adb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.326847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cda5ecf5-abec-49f3-b876-e4412965adb1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:31.329927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cda5ecf5-abec-49f3-b876-e4412965adb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:31.334314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:31.335214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.335727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.336224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.337166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:31.337669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:31.339323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:31.355457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 87/168] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/role_assignments?user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=e606be389f29465393427b1abb34b098 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:31.356978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.447935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 82/169] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:31.502963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641a53-d41d-47e0-9675-b8a21a0a5e45 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.503288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641a53-d41d-47e0-9675-b8a21a0a5e45 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.503567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641a53-d41d-47e0-9675-b8a21a0a5e45 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.505270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 83/170] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:31.508882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641a53-d41d-47e0-9675-b8a21a0a5e45 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.559820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.571843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.579732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d19e4-a90f-4f53-87b0-d3a1924a4805 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:31.633853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641a53-d41d-47e0-9675-b8a21a0a5e45 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:31.662861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf278826-3c37-4423-b469-95e02daf894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:31.663373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278826-3c37-4423-b469-95e02daf894d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.663674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278826-3c37-4423-b469-95e02daf894d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.663942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278826-3c37-4423-b469-95e02daf894d None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.664620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf278826-3c37-4423-b469-95e02daf894d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:31.664919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf278826-3c37-4423-b469-95e02daf894d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:31.666310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf278826-3c37-4423-b469-95e02daf894d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:31.688741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 88/171] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:31.689872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37e383-1b09-4d46-9113-a9ae0ccf6bfd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.694858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37e383-1b09-4d46-9113-a9ae0ccf6bfd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.695227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37e383-1b09-4d46-9113-a9ae0ccf6bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.709505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:31.710158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.710432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.710702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.734983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ef37e383-1b09-4d46-9113-a9ae0ccf6bfd None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:31.736556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:31.742196 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ef37e383-1b09-4d46-9113-a9ae0ccf6bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:31.744659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:31.745581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 84/172] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:31.746380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.847938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 89/173] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:31.849017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37e383-1b09-4d46-9113-a9ae0ccf6bfd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.879822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.885007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcf32a-f10f-477c-9beb-9c169cbf370d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:31.942420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:31.943341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:31.943776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:31.944203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:31.950625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:31.952302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:31.954758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 85/174] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:31.956098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:31.985912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:31.997415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37e383-1b09-4d46-9113-a9ae0ccf6bfd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:32.039439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:32.039439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.039439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.039439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.039872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:32.039872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:32.041023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:32.050807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 90/175] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:32.055434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:32.113127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377bd4-4f18-47dc-8e06-e9bd195cec89 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:32.165600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:32.166240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.166513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.168036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.190033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:32.194811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:32.195726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:32.196510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:32.201603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535eb7c-13b4-498e-8fb7-29e9af107023 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:32.203932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 86/176] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:32.204987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:32.275442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b44f2-bb96-4515-87e4-1d64ec97ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:32.275442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b44f2-bb96-4515-87e4-1d64ec97ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.275442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b44f2-bb96-4515-87e4-1d64ec97ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.275442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b44f2-bb96-4515-87e4-1d64ec97ffa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.278481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:32.319103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:32.379355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b44f2-bb96-4515-87e4-1d64ec97ffa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:32.381905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b44f2-bb96-4515-87e4-1d64ec97ffa6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:32.400285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfbc6f-5a55-45a9-b21b-e10dd2b666fa None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:32.440785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:32.442061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.442468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.443198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] PATH_INFO: `/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.460824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] RBAC: Authorizing `identity:get_user(user_id=ba795c48fdd74aa1a69b299c5d9d8c45)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:32.463301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:32.471669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 87/177] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:32 2022] GET /identity/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:32.473243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:32.515611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 91/178] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:32.516869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c360-f24f-4e8e-8fad-47dc84f12cf9 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.517148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c360-f24f-4e8e-8fad-47dc84f12cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.517417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c360-f24f-4e8e-8fad-47dc84f12cf9 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.522616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 92/179] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:32.522616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622419-07ea-4d26-bec0-c08513dac073 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.522616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622419-07ea-4d26-bec0-c08513dac073 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.522616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622419-07ea-4d26-bec0-c08513dac073 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.522616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 93/180] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:32.528390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622419-07ea-4d26-bec0-c08513dac073 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:32.597857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:32.601908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:32.622982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fff9c-9338-4de1-9573-671391f4fdc2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:32.665506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622419-07ea-4d26-bec0-c08513dac073 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:32.683619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:32.684538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.684837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.685105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.685781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:32.686079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:32.687609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:32.701053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 88/181] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:32.701053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:32.712832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fe41b-f25f-4c3c-9f4e-0181ebb29533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:32.713444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fe41b-f25f-4c3c-9f4e-0181ebb29533 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.713729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fe41b-f25f-4c3c-9f4e-0181ebb29533 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.714001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fe41b-f25f-4c3c-9f4e-0181ebb29533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.786061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fe41b-f25f-4c3c-9f4e-0181ebb29533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:32.787793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fe41b-f25f-4c3c-9f4e-0181ebb29533 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:32.805085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ee53-ee71-412d-a6b2-e27adf4f6e45 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:32.839909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90b8bc-2049-4c53-99a1-4de8fc4ef892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:32.840533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b8bc-2049-4c53-99a1-4de8fc4ef892 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.840804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b8bc-2049-4c53-99a1-4de8fc4ef892 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.841072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b8bc-2049-4c53-99a1-4de8fc4ef892 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.842181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90b8bc-2049-4c53-99a1-4de8fc4ef892 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:32.843684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90b8bc-2049-4c53-99a1-4de8fc4ef892 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:32.850464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 89/182] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:32 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:32.850464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a35aa-939c-4c15-a976-637991862aa0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.850464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a35aa-939c-4c15-a976-637991862aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.850464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a35aa-939c-4c15-a976-637991862aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.851405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:32.865343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d09a35aa-939c-4c15-a976-637991862aa0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:32.866516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d09a35aa-939c-4c15-a976-637991862aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:32.878250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:32.912102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 94/183] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:32.912102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11129b7-45bc-428f-a1cf-8f122726d31c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:32.912102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11129b7-45bc-428f-a1cf-8f122726d31c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:32.912102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11129b7-45bc-428f-a1cf-8f122726d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:32.930854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b11129b7-45bc-428f-a1cf-8f122726d31c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:32.932135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b11129b7-45bc-428f-a1cf-8f122726d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:32.937063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 90/184] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:32.938498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a35aa-939c-4c15-a976-637991862aa0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.010882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 95/185] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:33.011759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11129b7-45bc-428f-a1cf-8f122726d31c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.062955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a35aa-939c-4c15-a976-637991862aa0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.098263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.098939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.099156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.099450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] PATH_INFO: `/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.100544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] RBAC: Authorizing `identity:get_user(user_id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.101988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.108072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 91/186] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:32 2022] GET /identity/v3/users/c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:33.108072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.110727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.122135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.130140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11129b7-45bc-428f-a1cf-8f122726d31c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.171076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.172104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.172692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.172969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.173836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] RBAC: Adding query filter params (role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:33.174139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.175681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.181829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 96/187] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/role_assignments?user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:33.182542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.221998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439332d-9b9f-4566-9a60-2e7457b57f56 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.263093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.263758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.264032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.264297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.266110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.267625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.274180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 92/188] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:33.274180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.303178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f6f7b-cb82-4069-97fa-9cb24c45669d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.342382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.343045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.343329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.343761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.348343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.348343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.349671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 97/189] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:33.354937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.373188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.375160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.397909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a2f6-3ad3-4f77-939d-976e23b6efd8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.434352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf71834-32f7-4b4c-95c8-2a4f813524c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.434907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf71834-32f7-4b4c-95c8-2a4f813524c7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.435182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf71834-32f7-4b4c-95c8-2a4f813524c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.435482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf71834-32f7-4b4c-95c8-2a4f813524c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.445945 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf71834-32f7-4b4c-95c8-2a4f813524c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-daf71834-32f7-4b4c-95c8-2a4f813524c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:33.450654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:33.451611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:33.452938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:33.457385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 93/190] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:33.458704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b7e7-8ac3-430f-a6f4-9a7eb64abb4d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.458992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b7e7-8ac3-430f-a6f4-9a7eb64abb4d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.459266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b7e7-8ac3-430f-a6f4-9a7eb64abb4d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.460547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 94/191] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:33.461307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1b7e7-8ac3-430f-a6f4-9a7eb64abb4d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.467622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801e207-76d6-4b27-af71-7764c1f995a3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.502276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.502972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.503324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.503680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.561078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1b7e7-8ac3-430f-a6f4-9a7eb64abb4d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.569977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.571462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.588520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.595295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.595922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.596197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.596467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.597181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=ba795c48fdd74aa1a69b299c5d9d8c45) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:33.597481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.598920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.604294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 95/192] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/role_assignments?user.id=ba795c48fdd74aa1a69b299c5d9d8c45&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:33.605039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.613989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.694984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 98/193] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:33.695794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.725054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72d3c0-1192-470b-be07-4d5741a1e127 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.763833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495452a-53e7-4841-a3e6-df536d5ff0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.764451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495452a-53e7-4841-a3e6-df536d5ff0bd None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.764737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495452a-53e7-4841-a3e6-df536d5ff0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.765068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495452a-53e7-4841-a3e6-df536d5ff0bd None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.765724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495452a-53e7-4841-a3e6-df536d5ff0bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.767280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495452a-53e7-4841-a3e6-df536d5ff0bd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.789490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 96/194] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:57:33 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:33.790797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e4680-2567-4cdc-8a40-6ac7379385db None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.791088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e4680-2567-4cdc-8a40-6ac7379385db None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.791508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e4680-2567-4cdc-8a40-6ac7379385db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.813890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-547e4680-2567-4cdc-8a40-6ac7379385db None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:33.815107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-547e4680-2567-4cdc-8a40-6ac7379385db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:33.827945 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5541507-54e0-4cce-a516-695e56c58eb5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:33.852900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.882651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:33.884349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:33.884633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:33.884903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:33.885588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:33.885888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:33.887294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:33.898729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 99/195] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:33.899625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:33.902988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:33.919223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 97/196] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:33.920497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e4680-2567-4cdc-8a40-6ac7379385db None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.026416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3dd43-9ae1-4656-87e7-3ef9ecb847e4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.057232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e4680-2567-4cdc-8a40-6ac7379385db None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.071355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.072358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.072611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.072845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] PATH_INFO: `/v3/projects/eb643c703dee4be5b0d7875e83bc25a5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.074454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] RBAC: Authorizing `identity:get_project(project_id=eb643c703dee4be5b0d7875e83bc25a5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:34.076279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:34.078841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 100/197] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/projects/eb643c703dee4be5b0d7875e83bc25a5 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:34.079515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.114930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.115856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.116138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.116914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] PATH_INFO: `/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.118327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] RBAC: Authorizing `identity:get_user(user_id=ba795c48fdd74aa1a69b299c5d9d8c45)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:34.120171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:34.121984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 98/198] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:33 2022] GET /identity/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:34.127349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.137339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:34.202921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:34.214657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ee5ce-21cc-4c84-9ac0-a0a7ec2c32f7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.261949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d592e7-bfc7-45c9-b856-4d9ecc3899bb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.263261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.264257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.264589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.265422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.281398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:34.287975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:34.288886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:34.289691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 101/199] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:34.290374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.319983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.321008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.321483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.321949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.322875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, scope.project.id=eb643c703dee4be5b0d7875e83bc25a5, user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:34.323389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:34.325151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:34.334620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 99/200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/role_assignments?user.id=c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9&scope.project.id=eb643c703dee4be5b0d7875e83bc25a5&role.id=e606be389f29465393427b1abb34b098 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:34.335893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.440572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dc17c-c9b2-4ccd-8af4-a154e26cdd08 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.450079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:34.475446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde7f1-f49e-49f6-8f51-94aa55c3564d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.487589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.488461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.488889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.489306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.525107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:34.550873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.551935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.552415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.552881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.553751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:34.554383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:34.556069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:34.574869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 100/201] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:34.582753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:34.584359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:34.598107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.720786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 102/202] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:34.726568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.739863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:34.754605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859a9cb-c61d-4c63-a95a-9460fd3e4749 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.804076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.804640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.804918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.805813 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] PATH_INFO: `/v3/users/c646d3eec3524ef08f972dd476cdde60` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.807434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] RBAC: Authorizing `identity:get_user(user_id=c646d3eec3524ef08f972dd476cdde60)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:34.809212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:34.810955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 101/203] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/users/c646d3eec3524ef08f972dd476cdde60 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:34.817702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:34.910124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de28f0a-e020-43fc-8576-cab649823941 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:34.945456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:34.948682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:34.949624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:34.950114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:34.950582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:34.952516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:34.954401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:34.956702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 103/204] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:34.965013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:35.058044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:35.064564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a5c0-a36d-489c-8935-c28af835d198 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:35.082516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370045-ff1c-4261-96b5-f04c84b20364 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:35.117406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:35.118080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.118355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.118630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.119405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] RBAC: Adding query filter params (role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=ba795c48fdd74aa1a69b299c5d9d8c45) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:35.119742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:35.121190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:35.123540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:35.124176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.124491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.124758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.126955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 104/205] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/role_assignments?user.id=ba795c48fdd74aa1a69b299c5d9d8c45&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:35.231589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:35.233081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:35.314562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:35.391706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 102/206] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:57:35.397636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:35.539764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f2c49-13f5-4522-a4cf-69263d68f516 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:35.577441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6bc6e-c97d-43bc-be74-fff3b9c20433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:35.578448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6bc6e-c97d-43bc-be74-fff3b9c20433 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.578936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6bc6e-c97d-43bc-be74-fff3b9c20433 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.579402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6bc6e-c97d-43bc-be74-fff3b9c20433 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.580847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6bc6e-c97d-43bc-be74-fff3b9c20433 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:35.582481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6bc6e-c97d-43bc-be74-fff3b9c20433 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:35.584662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 105/207] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:35 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:35.590874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:35.740607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efe63-be43-40d7-a541-6f16d822e7bc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:35.799227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a13ce-2c08-41a9-b5fd-911e1c068676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:35.799912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a13ce-2c08-41a9-b5fd-911e1c068676 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.800226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a13ce-2c08-41a9-b5fd-911e1c068676 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.800502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a13ce-2c08-41a9-b5fd-911e1c068676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.801320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a13ce-2c08-41a9-b5fd-911e1c068676 None admin] RBAC: Adding query filter params (role.id=918555c720174958942568d7b3913066, scope.project.id=e6e651f72afb4d498852b26955899a41, user.id=c646d3eec3524ef08f972dd476cdde60) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:35.801655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a13ce-2c08-41a9-b5fd-911e1c068676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:35.803284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a13ce-2c08-41a9-b5fd-911e1c068676 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:35.817580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 103/208] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:35 2022] GET /identity/v3/role_assignments?user.id=c646d3eec3524ef08f972dd476cdde60&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=918555c720174958942568d7b3913066 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:35.893561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829d5e-d742-412e-901a-6f4f55643bd7 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.894240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829d5e-d742-412e-901a-6f4f55643bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.894713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829d5e-d742-412e-901a-6f4f55643bd7 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.896497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 106/209] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:35.902086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d555-746f-4ef8-ae71-63c5d682de46 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:35.902362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d555-746f-4ef8-ae71-63c5d682de46 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:35.902646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d555-746f-4ef8-ae71-63c5d682de46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:35.933319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b6c4d555-746f-4ef8-ae71-63c5d682de46 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:35.934795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b6c4d555-746f-4ef8-ae71-63c5d682de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:35.960698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:36.042037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 104/210] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:36.065606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829d5e-d742-412e-901a-6f4f55643bd7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:36.076680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:36.188358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829d5e-d742-412e-901a-6f4f55643bd7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:36.226900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:36.227571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.227852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.228130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.242597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:36.247390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:36.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:36.249678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 107/211] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:36.255861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d555-746f-4ef8-ae71-63c5d682de46 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:36.375261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d555-746f-4ef8-ae71-63c5d682de46 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:36.415583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9deb2-77a7-4333-b6cb-5badd91d9ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:36.416204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9deb2-77a7-4333-b6cb-5badd91d9ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.416479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9deb2-77a7-4333-b6cb-5badd91d9ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.416748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9deb2-77a7-4333-b6cb-5badd91d9ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.417426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9deb2-77a7-4333-b6cb-5badd91d9ec4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:36.417725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9deb2-77a7-4333-b6cb-5badd91d9ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:36.419119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9deb2-77a7-4333-b6cb-5badd91d9ec4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:36.428885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 105/212] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:36.434674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:36.504277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:36.506034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81b859-f756-4995-8fc2-f6f3ed36565e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.506542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81b859-f756-4995-8fc2-f6f3ed36565e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.507011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81b859-f756-4995-8fc2-f6f3ed36565e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.508569 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 106/213] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:36.513669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cc63a-c955-4c55-8d92-5e50069e95b1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.514186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cc63a-c955-4c55-8d92-5e50069e95b1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.515246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cc63a-c955-4c55-8d92-5e50069e95b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.534405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9f6cc63a-c955-4c55-8d92-5e50069e95b1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:36.535986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9f6cc63a-c955-4c55-8d92-5e50069e95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:36.540087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:36.548760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad09c-2d9b-463f-b225-190ed28973df None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:36.593123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:36.593761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.594041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.594315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] PATH_INFO: `/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.595931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ba795c48fdd74aa1a69b299c5d9d8c45)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:36.597728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:36.600350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 108/214] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:36 2022] GET /identity/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:36.606816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:36.614729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 107/215] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:36.639686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cc63a-c955-4c55-8d92-5e50069e95b1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:36.738673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef465-17e4-470d-870c-61462f2a75e7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:36.751350 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cc63a-c955-4c55-8d92-5e50069e95b1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:36.775939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32ac54-a062-4d87-96a9-bd5dc28ee8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:36.776797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32ac54-a062-4d87-96a9-bd5dc28ee8de None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.777080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32ac54-a062-4d87-96a9-bd5dc28ee8de None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.777365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32ac54-a062-4d87-96a9-bd5dc28ee8de None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.778527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32ac54-a062-4d87-96a9-bd5dc28ee8de None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:36.780014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32ac54-a062-4d87-96a9-bd5dc28ee8de None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:36.782613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 109/216] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:36 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:36.783833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702bef7-150f-4508-a22c-616c0d2a4774 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.784117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702bef7-150f-4508-a22c-616c0d2a4774 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.784393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702bef7-150f-4508-a22c-616c0d2a4774 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.785598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 110/217] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:36.788773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702bef7-150f-4508-a22c-616c0d2a4774 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:36.790164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938866fa-d34a-4793-8774-de5110f43db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:36.791126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938866fa-d34a-4793-8774-de5110f43db7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.791657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938866fa-d34a-4793-8774-de5110f43db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.792113 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938866fa-d34a-4793-8774-de5110f43db7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.792574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:36.803014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:36.807543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938866fa-d34a-4793-8774-de5110f43db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-938866fa-d34a-4793-8774-de5110f43db7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:36.813503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:36.814574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:36.815386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 108/218] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:36.816471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2f67c-394d-4b8e-94ad-7b80d3dd7df6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.816471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2f67c-394d-4b8e-94ad-7b80d3dd7df6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.816471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2f67c-394d-4b8e-94ad-7b80d3dd7df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.834269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a8e2f67c-394d-4b8e-94ad-7b80d3dd7df6 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:36.835496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a8e2f67c-394d-4b8e-94ad-7b80d3dd7df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:36.905874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 109/219] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:36.906718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2f67c-394d-4b8e-94ad-7b80d3dd7df6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:36.913766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702bef7-150f-4508-a22c-616c0d2a4774 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:36.954474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:36.955131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:36.955422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:36.955775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/ba795c48fdd74aa1a69b299c5d9d8c45/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:36.957784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] RBAC: Authorizing `identity:create_grant(project_id=10bafec90d23450dbc1d1f64870e5868, user_id=ba795c48fdd74aa1a69b299c5d9d8c45, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:36.959362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:36.972735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 111/220] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:36 2022] PUT /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/ba795c48fdd74aa1a69b299c5d9d8c45/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:57:36.981156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:37.023069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2f67c-394d-4b8e-94ad-7b80d3dd7df6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:37.057942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:37.066915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:37.067635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.067917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.068239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.068977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:37.069284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:37.071012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:37.078777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:37.081197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 110/221] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:37.086395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:37.138582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab955b-f4a8-420d-b761-ee0f299e2f8a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:37.188177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:37.188936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.189219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.189495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.190623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:37.192296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:37.193883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 112/222] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:37.199367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:37.211731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cddb2-d0d4-460d-9ed2-92e1fe477130 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:37.247759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:37.248442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.248720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.248990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] PATH_INFO: `/v3/users/77fb67d1446d4d2cb966090603163f99` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.263583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] RBAC: Authorizing `identity:get_user(user_id=77fb67d1446d4d2cb966090603163f99)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:37.265108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:37.266795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 111/223] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:37 2022] GET /identity/v3/users/77fb67d1446d4d2cb966090603163f99 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:37.272210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:37.329751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c31448-bdac-49c7-b98d-4635770eb028 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:37.333848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:37.369716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:37.378917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:37.379585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.380134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.380407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.381511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:37.383549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:37.389651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461272-eddf-4603-8985-b3f9438ad659 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:37.423185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 113/224] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:57:37 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:37.433171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb2ee-90e7-4a74-a15b-494daa70e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:37.434131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb2ee-90e7-4a74-a15b-494daa70e254 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.434402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb2ee-90e7-4a74-a15b-494daa70e254 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.434666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb2ee-90e7-4a74-a15b-494daa70e254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.515712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb2ee-90e7-4a74-a15b-494daa70e254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:37.517197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb2ee-90e7-4a74-a15b-494daa70e254 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:37.571729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:37.632735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 112/225] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:57:37.638415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:37.724238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24aef-0627-4093-820e-64fe933facba None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.724582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24aef-0627-4093-820e-64fe933facba None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.724787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24aef-0627-4093-820e-64fe933facba None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.726138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 113/226] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:37.732804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c113-4cc4-4649-bf66-4ccb4c3540a3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.733078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c113-4cc4-4649-bf66-4ccb4c3540a3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.733379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c113-4cc4-4649-bf66-4ccb4c3540a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.746475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a2a4-99ef-4a86-a807-6c9c408b1ace None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:37.758120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f975c113-4cc4-4649-bf66-4ccb4c3540a3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:37.759310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f975c113-4cc4-4649-bf66-4ccb4c3540a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:37.803021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:37.803790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.804070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.804340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.805474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:37.807096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:37.809331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 114/227] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:37 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:37.816669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:37.851388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 114/228] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:37.875529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975c113-4cc4-4649-bf66-4ccb4c3540a3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:37.879301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:37.941018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d0534-40fa-4678-8172-8e764bcfa62b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:37.972654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:37.988957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:37.989636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:37.989997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:37.990496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:37.991281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=77fb67d1446d4d2cb966090603163f99) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:37.991623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:37.993770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:37.998922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975c113-4cc4-4649-bf66-4ccb4c3540a3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:38.001553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 115/229] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:37 2022] GET /identity/v3/role_assignments?user.id=77fb67d1446d4d2cb966090603163f99&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=e606be389f29465393427b1abb34b098 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:38.045434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:38.046943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.047372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.047797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.060330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:38.066032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:38.067165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:38.068186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:38.070124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 115/230] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:38.076012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:38.240005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72422d45-0b53-4854-b383-47214eb87fe1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:38.261989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:38.284597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:38.285474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.285750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.286015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.286682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:38.286974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:38.288382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:38.314812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 116/231] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:38.320651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:38.479829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d97a3-b89a-42e5-9266-5daa24a8f7d8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:38.523702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:38.524259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.524540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.524811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] PATH_INFO: `/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.525960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] RBAC: Authorizing `identity:get_user(user_id=ba795c48fdd74aa1a69b299c5d9d8c45)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:38.527440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:38.529105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 116/232] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:38 2022] GET /identity/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:38.535273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:38.669697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7617d9-be2f-4813-9809-85e64a8289e9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:38.714376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8e2ee-796d-41ec-ae29-3fe601392206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:38.715006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8e2ee-796d-41ec-ae29-3fe601392206 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.715283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8e2ee-796d-41ec-ae29-3fe601392206 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.715579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8e2ee-796d-41ec-ae29-3fe601392206 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.719919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8e2ee-796d-41ec-ae29-3fe601392206 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:38.721440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8e2ee-796d-41ec-ae29-3fe601392206 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:38.723165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 117/233] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:38 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:38.728787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:38.749631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:38.876125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c55302-fb67-4358-ba51-1bea31f4d997 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:38.925989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478906-efe7-4e55-9edf-b14703404100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:38.926662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478906-efe7-4e55-9edf-b14703404100 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:38.926943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478906-efe7-4e55-9edf-b14703404100 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:38.927216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478906-efe7-4e55-9edf-b14703404100 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/ba795c48fdd74aa1a69b299c5d9d8c45/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:38.929468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c478906-efe7-4e55-9edf-b14703404100 None admin] RBAC: Authorizing `identity:create_grant(project_id=10bafec90d23450dbc1d1f64870e5868, user_id=ba795c48fdd74aa1a69b299c5d9d8c45, role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:38.930940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c478906-efe7-4e55-9edf-b14703404100 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:38.950712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 117/234] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:38 2022] PUT /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/ba795c48fdd74aa1a69b299c5d9d8c45/roles/d4924cc22b334ebe9f07b5938e64913b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:57:39.330918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab319-c043-4261-86ac-d7a82188d39f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:39.331192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab319-c043-4261-86ac-d7a82188d39f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:39.331480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab319-c043-4261-86ac-d7a82188d39f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:39.333018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 118/235] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:39.338954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcacd86-c71e-4a58-8d1d-b8f4c7cbc861 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:39.339882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcacd86-c71e-4a58-8d1d-b8f4c7cbc861 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:39.340362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcacd86-c71e-4a58-8d1d-b8f4c7cbc861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:39.360348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-efcacd86-c71e-4a58-8d1d-b8f4c7cbc861 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:39.363290 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-efcacd86-c71e-4a58-8d1d-b8f4c7cbc861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:39.445786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:39.453841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 118/236] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:39.492295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ab319-c043-4261-86ac-d7a82188d39f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:39.563240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:39.629132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ab319-c043-4261-86ac-d7a82188d39f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:39.671736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:39.673255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:39.673739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:39.674229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:39.690641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:39.695814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:39.696686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:39.697489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:39.699873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 119/237] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:39.706716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcacd86-c71e-4a58-8d1d-b8f4c7cbc861 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:39.859309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcacd86-c71e-4a58-8d1d-b8f4c7cbc861 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:39.908558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:39.909169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:39.909446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:39.909716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:39.910385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:39.910682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:39.912098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:39.927624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 119/238] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:39.933377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.053733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e507b-b568-4fd5-a4c3-235286de6de4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:40.065957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:40.091290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b72c3-260e-492e-bff1-3a267c48ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:40.091946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b72c3-260e-492e-bff1-3a267c48ea96 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.092224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b72c3-260e-492e-bff1-3a267c48ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.092493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b72c3-260e-492e-bff1-3a267c48ea96 None admin] PATH_INFO: `/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.093736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b72c3-260e-492e-bff1-3a267c48ea96 None admin] RBAC: Authorizing `identity:get_user(user_id=ba795c48fdd74aa1a69b299c5d9d8c45)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:40.095183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b72c3-260e-492e-bff1-3a267c48ea96 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:40.097084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 120/239] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:39 2022] GET /identity/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:40.102634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.152983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb093-b07a-40f4-8191-1ec12366aeca None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.153166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb093-b07a-40f4-8191-1ec12366aeca None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.153439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb093-b07a-40f4-8191-1ec12366aeca None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.155781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 121/240] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:40.164275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e50e-a6f3-4388-aab6-6f1d6cccd673 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.164552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e50e-a6f3-4388-aab6-6f1d6cccd673 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.165089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e50e-a6f3-4388-aab6-6f1d6cccd673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.189544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a1d4e50e-a6f3-4388-aab6-6f1d6cccd673 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:40.190737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a1d4e50e-a6f3-4388-aab6-6f1d6cccd673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:40.232832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:40.268798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 122/241] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:40.304125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4e50e-a6f3-4388-aab6-6f1d6cccd673 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.364582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f56f0-cf70-4422-a030-e72b7625ac39 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:40.409003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4e50e-a6f3-4388-aab6-6f1d6cccd673 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:40.419917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6145b6-906a-4f46-ab28-3752d73137b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:40.420871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6145b6-906a-4f46-ab28-3752d73137b1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.421326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6145b6-906a-4f46-ab28-3752d73137b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.421857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6145b6-906a-4f46-ab28-3752d73137b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.431873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:40.447376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf08bb8-7322-415e-a45f-9c3e74a022ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:40.448213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08bb8-7322-415e-a45f-9c3e74a022ae None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.448558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08bb8-7322-415e-a45f-9c3e74a022ae None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.448896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08bb8-7322-415e-a45f-9c3e74a022ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.460879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf08bb8-7322-415e-a45f-9c3e74a022ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-daf08bb8-7322-415e-a45f-9c3e74a022ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:40.465938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:40.466834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:40.467705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 123/242] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:40.474270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a681-7ccc-4743-be15-8de82dc671c9 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.474626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a681-7ccc-4743-be15-8de82dc671c9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.474936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a681-7ccc-4743-be15-8de82dc671c9 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.476526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 124/243] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:40.480818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32a681-7ccc-4743-be15-8de82dc671c9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.503232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6145b6-906a-4f46-ab28-3752d73137b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:40.505061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6145b6-906a-4f46-ab28-3752d73137b1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:40.568665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:40.589721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32a681-7ccc-4743-be15-8de82dc671c9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:40.619675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 120/244] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:40.619675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b104589-f7f7-4912-b714-97591ef00ec9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.619675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b104589-f7f7-4912-b714-97591ef00ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.619675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b104589-f7f7-4912-b714-97591ef00ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.633162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239496ea-57ce-40e2-aa87-3fa2c29d939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:40.633780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239496ea-57ce-40e2-aa87-3fa2c29d939e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.634055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239496ea-57ce-40e2-aa87-3fa2c29d939e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.634321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239496ea-57ce-40e2-aa87-3fa2c29d939e None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.634990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239496ea-57ce-40e2-aa87-3fa2c29d939e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:40.635290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239496ea-57ce-40e2-aa87-3fa2c29d939e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:40.635707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8b104589-f7f7-4912-b714-97591ef00ec9 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:40.636709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239496ea-57ce-40e2-aa87-3fa2c29d939e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:40.636903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8b104589-f7f7-4912-b714-97591ef00ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:40.650143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 125/245] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:40.650143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da8fd-6c05-4d7d-ab9b-3b396ab3950e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.650143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da8fd-6c05-4d7d-ab9b-3b396ab3950e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.650143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da8fd-6c05-4d7d-ab9b-3b396ab3950e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.650143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 126/246] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:40.650143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601da8fd-6c05-4d7d-ab9b-3b396ab3950e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.682922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:40.717669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 121/247] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:40.718526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b104589-f7f7-4912-b714-97591ef00ec9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.785594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601da8fd-6c05-4d7d-ab9b-3b396ab3950e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:40.814513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:40.820781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89f19d-56f1-4727-b226-228833741cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:40.821415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89f19d-56f1-4727-b226-228833741cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.821696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89f19d-56f1-4727-b226-228833741cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.821975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89f19d-56f1-4727-b226-228833741cc2 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.823073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89f19d-56f1-4727-b226-228833741cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:40.824542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89f19d-56f1-4727-b226-228833741cc2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:40.826159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 127/248] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:40 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:40.826374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b104589-f7f7-4912-b714-97591ef00ec9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:40.827873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd19c2b-f28c-4d9f-9e76-cf58f6305757 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.828250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd19c2b-f28c-4d9f-9e76-cf58f6305757 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.828536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd19c2b-f28c-4d9f-9e76-cf58f6305757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.845795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9cd19c2b-f28c-4d9f-9e76-cf58f6305757 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:40.847122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9cd19c2b-f28c-4d9f-9e76-cf58f6305757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:40.866415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:40.867042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:40.867318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:40.867617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] PATH_INFO: `/v3/users/437887dd7e21432f826f49513467a007` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:40.881343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] RBAC: Authorizing `identity:get_user(user_id=437887dd7e21432f826f49513467a007)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:40.882815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:40.885021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 122/249] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:40 2022] GET /identity/v3/users/437887dd7e21432f826f49513467a007 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:40.885225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.922475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 128/250] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:40.923662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd19c2b-f28c-4d9f-9e76-cf58f6305757 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:40.957767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.002896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d24db-fa05-42e9-bf02-6621bdc14f5d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.036688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd19c2b-f28c-4d9f-9e76-cf58f6305757 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.038766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.039399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.039705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.039975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.051275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:41.055992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:41.056901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:41.057764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 123/251] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:41.058444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.076603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.088506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.089116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.089394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.089657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.090377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=ba795c48fdd74aa1a69b299c5d9d8c45) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:41.090682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.092155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.107448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 129/252] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:40 2022] GET /identity/v3/role_assignments?user.id=ba795c48fdd74aa1a69b299c5d9d8c45&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:41.107448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.200856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b360f-8f80-44c6-848e-c16794126afb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.214365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.225662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6ae5f-7c18-41bd-b875-98944e1f35cf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.254395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.255009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.255287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.255587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.281935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.282609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.283020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.283298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.284945 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.286692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.288809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 130/253] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:41.292065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.361639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.362576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.376647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.429984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83904e-af58-4058-8667-fe1f7fbfd729 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.466722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.467992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.468362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.468669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.469414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:41.469739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.471586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.478935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 124/254] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:41.478935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.483863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 131/255] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:41.484518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.507013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.585167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679c6e-3d12-406a-a7e6-44a8654b55ab None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.588654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5255-046d-4d54-be65-f3f5c28ee85c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.594091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.619368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27f152-fb22-459f-a90f-c043731b544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.619999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f152-fb22-459f-a90f-c043731b544a None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.620270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f152-fb22-459f-a90f-c043731b544a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.620534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f152-fb22-459f-a90f-c043731b544a None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.621166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27f152-fb22-459f-a90f-c043731b544a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.622001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.622594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27f152-fb22-459f-a90f-c043731b544a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.622686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.622888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.623160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.624845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.626306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.627969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 132/256] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:41.628720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.645707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 125/257] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:57:41 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:41.646907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360bda-806e-46da-a14c-447f3c370641 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.647188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360bda-806e-46da-a14c-447f3c370641 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.647478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360bda-806e-46da-a14c-447f3c370641 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.648680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 126/258] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:41.649391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360bda-806e-46da-a14c-447f3c370641 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.744668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.759354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3944d-cce5-4d05-b7da-c5f1a623a792 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.780167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360bda-806e-46da-a14c-447f3c370641 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:41.797355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f4175-63fc-4d6e-9306-3d4d0c3905af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.797989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4175-63fc-4d6e-9306-3d4d0c3905af None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.798262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4175-63fc-4d6e-9306-3d4d0c3905af None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.798535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4175-63fc-4d6e-9306-3d4d0c3905af None admin] PATH_INFO: `/v3/users/77fb67d1446d4d2cb966090603163f99` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.799681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f4175-63fc-4d6e-9306-3d4d0c3905af None admin] RBAC: Authorizing `identity:get_user(user_id=77fb67d1446d4d2cb966090603163f99)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.801170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f4175-63fc-4d6e-9306-3d4d0c3905af None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.802948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 133/259] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/users/77fb67d1446d4d2cb966090603163f99 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:41.803936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984af2a-786e-46e2-adcc-cdada9d3e5ea None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.804215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984af2a-786e-46e2-adcc-cdada9d3e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.804479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984af2a-786e-46e2-adcc-cdada9d3e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.824687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b984af2a-786e-46e2-adcc-cdada9d3e5ea None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:41.826103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b984af2a-786e-46e2-adcc-cdada9d3e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:41.836402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:41.837047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:41.837329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:41.837598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:41.838340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] RBAC: Adding query filter params (role.id=918555c720174958942568d7b3913066, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=437887dd7e21432f826f49513467a007) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:41.838648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:41.840219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:41.846780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 127/260] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/role_assignments?user.id=437887dd7e21432f826f49513467a007&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=918555c720174958942568d7b3913066 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:41.847617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.886941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:41.919265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 134/261] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:41.943111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984af2a-786e-46e2-adcc-cdada9d3e5ea None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:41.978172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d89f6d-c71c-44f2-aad5-6888812608d9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:42.035629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:42.036228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:42.036501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:42.036770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:42.037947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:42.039393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:42.041239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 128/262] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:42.047247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:42.071167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:42.092223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984af2a-786e-46e2-adcc-cdada9d3e5ea None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:42.145817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:42.146513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:42.146793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:42.147062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:42.158768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:42.163505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:42.164391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:42.165190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 135/263] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:42.170798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:42.207772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:42.213649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74429f-b0c2-4257-a8c9-d41daad2d56c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:42.266436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:42.267095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:42.267372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:42.267681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/77fb67d1446d4d2cb966090603163f99/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:42.272297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=10bafec90d23450dbc1d1f64870e5868, user_id=77fb67d1446d4d2cb966090603163f99, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:42.276830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:42.301794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 129/264] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:42 2022] PUT /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/77fb67d1446d4d2cb966090603163f99/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:57:42.340222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db044bc2-9a9b-4c9c-849c-d90d3f5093c7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:42.390039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:42.390985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:42.391334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:42.391635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:42.392338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:42.392647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:42.394093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:42.408045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 136/265] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:42.413903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:42.553952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82249ebe-3d21-4755-b885-6c406d2e5a36 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:42.592353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:42.593215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:42.593718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:42.594021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] PATH_INFO: `/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:42.595176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] RBAC: Authorizing `identity:get_user(user_id=ba795c48fdd74aa1a69b299c5d9d8c45)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:42.596684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:42.598438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 130/266] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:42 2022] GET /identity/v3/users/ba795c48fdd74aa1a69b299c5d9d8c45 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:42.603757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:42.616497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:42.734170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a2b91-5faf-499c-9927-17fffdc33d44 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:42.776710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:42.777329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:42.777591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:42.777860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:42.875092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:42.876517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:42.891845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:43.006852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 137/267] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:43.012348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:43.063255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:43.173090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f85f4-6f10-46c2-929a-41167dfe509b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:43.214279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1f616-1bb2-45b3-8323-4a2db2d6c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:43.214913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1f616-1bb2-45b3-8323-4a2db2d6c571 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:43.215190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1f616-1bb2-45b3-8323-4a2db2d6c571 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:43.215483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1f616-1bb2-45b3-8323-4a2db2d6c571 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:43.216616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1f616-1bb2-45b3-8323-4a2db2d6c571 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:43.218660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1f616-1bb2-45b3-8323-4a2db2d6c571 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:43.220326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 131/268] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:43 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:43.226152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:43.374660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75aa9-751d-4815-82b7-08a022cebbf5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:43.386132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:43.420037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0293b7-ff44-4d25-b089-49e7451bf83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:43.420685 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0293b7-ff44-4d25-b089-49e7451bf83b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:43.421022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0293b7-ff44-4d25-b089-49e7451bf83b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:43.421294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0293b7-ff44-4d25-b089-49e7451bf83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:43.422014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0293b7-ff44-4d25-b089-49e7451bf83b None admin] RBAC: Adding query filter params (role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=ba795c48fdd74aa1a69b299c5d9d8c45) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:43.422318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0293b7-ff44-4d25-b089-49e7451bf83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:43.425473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0293b7-ff44-4d25-b089-49e7451bf83b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:43.438517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 138/269] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:43 2022] GET /identity/v3/role_assignments?user.id=ba795c48fdd74aa1a69b299c5d9d8c45&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:44.220740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10636d7-8cb4-46f2-b04e-bfafa530440c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.221491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10636d7-8cb4-46f2-b04e-bfafa530440c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.221491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10636d7-8cb4-46f2-b04e-bfafa530440c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.223131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 132/270] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:44.228757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884241-a8f3-47ac-b3b0-6d44fd5e4ed6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.229246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884241-a8f3-47ac-b3b0-6d44fd5e4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.229340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884241-a8f3-47ac-b3b0-6d44fd5e4ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.249995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bd884241-a8f3-47ac-b3b0-6d44fd5e4ed6 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:44.251252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bd884241-a8f3-47ac-b3b0-6d44fd5e4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:44.317134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd51a8-0596-4ce5-aa65-94376d5fbb04 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.317425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd51a8-0596-4ce5-aa65-94376d5fbb04 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.317677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd51a8-0596-4ce5-aa65-94376d5fbb04 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.319380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 133/271] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:44.324967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828680bc-78ce-416d-8113-7e1debec6c94 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.325522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828680bc-78ce-416d-8113-7e1debec6c94 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.325693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828680bc-78ce-416d-8113-7e1debec6c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.331439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 139/272] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:44.332716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9be1f2-a339-4f69-b965-dadb40bf0bbe None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.333004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9be1f2-a339-4f69-b965-dadb40bf0bbe None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.333276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9be1f2-a339-4f69-b965-dadb40bf0bbe None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.335460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 140/273] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:44.341419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4132bb5-50eb-4d19-98b9-959db8b25e0c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.341697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4132bb5-50eb-4d19-98b9-959db8b25e0c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.341967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4132bb5-50eb-4d19-98b9-959db8b25e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.355824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-828680bc-78ce-416d-8113-7e1debec6c94 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:44.357007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-828680bc-78ce-416d-8113-7e1debec6c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:44.360964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b4132bb5-50eb-4d19-98b9-959db8b25e0c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:44.362118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b4132bb5-50eb-4d19-98b9-959db8b25e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:44.428157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 134/274] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:44.432889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 141/275] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:44.437159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828680bc-78ce-416d-8113-7e1debec6c94 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.450843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4132bb5-50eb-4d19-98b9-959db8b25e0c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.463013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:44.487028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:44.544931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828680bc-78ce-416d-8113-7e1debec6c94 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:44.563722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4132bb5-50eb-4d19-98b9-959db8b25e0c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:44.578799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:44.579444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.579726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.579994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.589946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:44.595174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:44.596208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:44.597061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 135/276] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:44.597716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.606903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:44.607556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.607829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.608118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.618175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:44.622930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:44.624202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:44.624994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 142/277] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:44.625636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.693591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:44.713417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365a08-0f02-45f5-8c77-08fd7ab959b1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:44.726602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:44.736282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf937a-f16b-4724-b3fa-71f4991b01ab None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:44.751663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:44.752218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.752491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.752755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.754074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:44.755530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:44.761664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 136/278] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:44.761664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.778039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:44.778795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.779078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.779352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.780683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:44.781236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:44.782681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:44.791206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 143/279] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:44.792028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.871562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed4ab-4cfd-424c-8b69-3ffc2c49f403 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:44.896942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bb38d-8cb7-4914-ac72-72b4412932ea None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:44.907751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:44.908352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.908621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.908890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.909547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:44.909846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:44.911216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:44.919143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 137/280] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:44.919143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.929488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75893c81-9c50-45da-a044-7d625adef416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:44.930091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75893c81-9c50-45da-a044-7d625adef416 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.930365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75893c81-9c50-45da-a044-7d625adef416 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.930631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75893c81-9c50-45da-a044-7d625adef416 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.931258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75893c81-9c50-45da-a044-7d625adef416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:44.932731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75893c81-9c50-45da-a044-7d625adef416 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:44.935208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:44.954572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 144/281] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:57:44 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:44.955960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e7a5-8359-4cda-952d-db7b8b272a19 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:44.956279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e7a5-8359-4cda-952d-db7b8b272a19 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:44.956527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e7a5-8359-4cda-952d-db7b8b272a19 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:44.957913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 145/282] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:44.960346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e7a5-8359-4cda-952d-db7b8b272a19 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:44.985049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:45.035875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58cf05-c1d2-4cb7-804b-82ecacf35393 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:45.072225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9730afb-d4e6-4129-bf78-cd8ef63487c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:45.072871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9730afb-d4e6-4129-bf78-cd8ef63487c7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.073150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9730afb-d4e6-4129-bf78-cd8ef63487c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.073422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9730afb-d4e6-4129-bf78-cd8ef63487c7 None admin] PATH_INFO: `/v3/users/8d94cc0ce64a4031b6ad70bafcb0f1e0` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.089382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9730afb-d4e6-4129-bf78-cd8ef63487c7 None admin] RBAC: Authorizing `identity:get_user(user_id=8d94cc0ce64a4031b6ad70bafcb0f1e0)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:45.090876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9730afb-d4e6-4129-bf78-cd8ef63487c7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:45.092668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 138/283] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:44 2022] GET /identity/v3/users/8d94cc0ce64a4031b6ad70bafcb0f1e0 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:45.093889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552fd7-5cac-4a41-9650-dece6ea328e2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.094168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552fd7-5cac-4a41-9650-dece6ea328e2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.094436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552fd7-5cac-4a41-9650-dece6ea328e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.099309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e7a5-8359-4cda-952d-db7b8b272a19 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:45.113467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1f552fd7-5cac-4a41-9650-dece6ea328e2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:45.114658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1f552fd7-5cac-4a41-9650-dece6ea328e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:45.140807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:45.141505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.141791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.142064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] PATH_INFO: `/v3/users/437887dd7e21432f826f49513467a007` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.143202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] RBAC: Authorizing `identity:get_user(user_id=437887dd7e21432f826f49513467a007)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:45.144737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:45.146478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 146/284] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:44 2022] GET /identity/v3/users/437887dd7e21432f826f49513467a007 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:45.147079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:45.205536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:45.210023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 139/285] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:45.215086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f552fd7-5cac-4a41-9650-dece6ea328e2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:45.246229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:45.274154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c831-2c15-4c0e-bde6-c5dea5f4b81f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:45.324040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:45.324749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.325095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.325435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.326230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, user.id=8d94cc0ce64a4031b6ad70bafcb0f1e0, scope.system=all) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:45.327401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:45.328945 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:45.334308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 147/286] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 07:57:45 2022] GET /identity/v3/role_assignments?user.id=8d94cc0ce64a4031b6ad70bafcb0f1e0&scope.system=all&role.id=e606be389f29465393427b1abb34b098 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:45.339499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:45.350501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f552fd7-5cac-4a41-9650-dece6ea328e2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:45.392731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:45.393377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.393652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.393922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.395109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:45.396805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:45.403684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 140/287] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:45 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:45.405702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:45.498867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:45.536528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2aab8-4c15-481c-b557-7a8a15dc2138 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:45.568553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5b878-640e-4423-ae10-f9f0cca0715f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:45.581034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:45.582492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.582785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.583064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/437887dd7e21432f826f49513467a007/roles/918555c720174958942568d7b3913066` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.586544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] RBAC: Authorizing `identity:create_grant(project_id=10bafec90d23450dbc1d1f64870e5868, user_id=437887dd7e21432f826f49513467a007, role_id=918555c720174958942568d7b3913066)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:45.588018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:45.612702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 141/288] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:57:45 2022] PUT /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868/users/437887dd7e21432f826f49513467a007/roles/918555c720174958942568d7b3913066 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:57:45.627203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:45.627890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.628207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.628476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.641238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:45.646791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:45.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:45.648549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 148/289] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:45.654506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:45.811047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538b2f-0ebd-40be-bede-3c26b3df3205 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:45.845208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:45.855524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:45.856518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:45.856978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:45.857428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:45.858396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:45.859048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:45.860755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:45.870715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 142/290] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:45.877298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:45.886098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:46.016392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd036d75-40c1-4775-af34-ccbedf114292 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:46.055130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:46.055832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:46.056112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:46.056438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] PATH_INFO: `/v3/users/77fb67d1446d4d2cb966090603163f99` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:46.057567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] RBAC: Authorizing `identity:get_user(user_id=77fb67d1446d4d2cb966090603163f99)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:46.059273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:46.061264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 149/291] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:45 2022] GET /identity/v3/users/77fb67d1446d4d2cb966090603163f99 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:46.068222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:46.245206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfe7ef-5a95-4931-8946-73982be94686 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:46.295168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:46.297548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:46.298079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:46.298548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:46.382825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:46.395247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:46.396823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:46.522885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 143/292] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:46.528445 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:46.647788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:46.681088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fb3de-10f8-4465-831f-643af7cf74ac None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:46.727479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c89d7-7c0b-4fb4-8a6d-53d046a453f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:46.728521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c89d7-7c0b-4fb4-8a6d-53d046a453f0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:46.728997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c89d7-7c0b-4fb4-8a6d-53d046a453f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:46.729466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c89d7-7c0b-4fb4-8a6d-53d046a453f0 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:46.730796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c89d7-7c0b-4fb4-8a6d-53d046a453f0 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:46.732525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c89d7-7c0b-4fb4-8a6d-53d046a453f0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:46.734714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 150/293] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:46 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:46.741085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:46.884051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:46.897934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b855-288d-4bd0-af86-3d5a7866ee52 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:46.945414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c8dcb-e748-43d9-afa9-b4fd6900843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:46.946014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8dcb-e748-43d9-afa9-b4fd6900843c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:46.946286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8dcb-e748-43d9-afa9-b4fd6900843c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:46.946553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8dcb-e748-43d9-afa9-b4fd6900843c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:46.947263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c8dcb-e748-43d9-afa9-b4fd6900843c None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=77fb67d1446d4d2cb966090603163f99) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:46.947591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c8dcb-e748-43d9-afa9-b4fd6900843c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:46.949010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c8dcb-e748-43d9-afa9-b4fd6900843c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:46.955357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 144/294] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:46 2022] GET /identity/v3/role_assignments?user.id=77fb67d1446d4d2cb966090603163f99&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=e606be389f29465393427b1abb34b098 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:47.403305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134132-9cc2-4e67-a994-22ef924fd9f5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.403969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134132-9cc2-4e67-a994-22ef924fd9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.404466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134132-9cc2-4e67-a994-22ef924fd9f5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.406665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 151/295] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:47.412087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01560a7-02b4-4522-9773-440bb31264bf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.412949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01560a7-02b4-4522-9773-440bb31264bf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.413438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01560a7-02b4-4522-9773-440bb31264bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.436005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c01560a7-02b4-4522-9773-440bb31264bf None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:47.437522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c01560a7-02b4-4522-9773-440bb31264bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:47.517121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 145/296] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:47.542137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134132-9cc2-4e67-a994-22ef924fd9f5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:47.656707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134132-9cc2-4e67-a994-22ef924fd9f5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:47.692768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac420f4-aa55-4033-9313-72f6fb892b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:47.693399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac420f4-aa55-4033-9313-72f6fb892b53 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.693670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac420f4-aa55-4033-9313-72f6fb892b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.693934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac420f4-aa55-4033-9313-72f6fb892b53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.700917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:47.706048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac420f4-aa55-4033-9313-72f6fb892b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5ac420f4-aa55-4033-9313-72f6fb892b53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:47.710743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:47.711677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:47.712489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 152/297] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:47.718279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01560a7-02b4-4522-9773-440bb31264bf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:47.763111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2609-175f-4eae-98e5-2a02ba4d1f6e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.763446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2609-175f-4eae-98e5-2a02ba4d1f6e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.763679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2609-175f-4eae-98e5-2a02ba4d1f6e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.765763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 153/298] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:47.771240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae2f4-9324-464b-8c0a-aa6efab6d666 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.771547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae2f4-9324-464b-8c0a-aa6efab6d666 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.771812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae2f4-9324-464b-8c0a-aa6efab6d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.791112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-06bae2f4-9324-464b-8c0a-aa6efab6d666 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:47.792792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-06bae2f4-9324-464b-8c0a-aa6efab6d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:47.820845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:47.844852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01560a7-02b4-4522-9773-440bb31264bf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:47.874372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 154/299] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:47.879745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcd64f-de71-4fd3-a8c3-8eb4fa207a36 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.879745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcd64f-de71-4fd3-a8c3-8eb4fa207a36 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.879745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcd64f-de71-4fd3-a8c3-8eb4fa207a36 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.879745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 155/300] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:47.882694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad54f-b7f4-407a-9b40-836da15cbe58 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.883003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad54f-b7f4-407a-9b40-836da15cbe58 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.883239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad54f-b7f4-407a-9b40-836da15cbe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.885188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:47.885957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:47.886444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:47.886870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:47.887707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:47.888143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:47.890282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:47.899280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 146/301] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:47.900325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:47.902719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-739ad54f-b7f4-407a-9b40-836da15cbe58 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:47.905243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-739ad54f-b7f4-407a-9b40-836da15cbe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:47.986589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 156/302] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:47.987342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad54f-b7f4-407a-9b40-836da15cbe58 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.016241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0476f-9dfb-4d0f-9d57-46bee2996dec None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.051127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.051791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.052064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.052332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.054212 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:48.063749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:48.069810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:48.070762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 147/303] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:48.072279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.085773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:48.102748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad54f-b7f4-407a-9b40-836da15cbe58 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.138734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.140169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.140466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.140739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] PATH_INFO: `/v3/users/a01dd302fe3b48c18ed5147e902d2e53` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.154352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] RBAC: Authorizing `identity:get_user(user_id=a01dd302fe3b48c18ed5147e902d2e53)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:48.155860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:48.162619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 157/304] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:47 2022] GET /identity/v3/users/a01dd302fe3b48c18ed5147e902d2e53 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:48.163594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.180577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbb85f-6e85-411e-85a3-d429f10645cc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.215033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.215741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.216019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.216284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.217419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:48.218871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:48.220457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 148/305] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:48.221201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.265773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055e83-efa4-4180-9c01-8a78f5b3f87f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.281719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:48.299260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf79ec-c697-4f34-9122-243888251ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.299907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf79ec-c697-4f34-9122-243888251ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.300180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf79ec-c697-4f34-9122-243888251ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.300446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf79ec-c697-4f34-9122-243888251ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.301103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf79ec-c697-4f34-9122-243888251ea8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:48.301400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf79ec-c697-4f34-9122-243888251ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:48.303138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf79ec-c697-4f34-9122-243888251ea8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:48.305672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:48.311710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 158/306] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:48.311710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634e5a0-6f80-4590-bb64-09e5bf393d5b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.311710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634e5a0-6f80-4590-bb64-09e5bf393d5b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.311710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634e5a0-6f80-4590-bb64-09e5bf393d5b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.311710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 159/307] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:48.311710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634e5a0-6f80-4590-bb64-09e5bf393d5b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.332393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41201ad-8302-47db-8834-77dd4438e17c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.368885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.369482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.369752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.370017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.370726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] RBAC: Adding query filter params (role.id=918555c720174958942568d7b3913066, user.id=a01dd302fe3b48c18ed5147e902d2e53, scope.system=all) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:48.371027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:48.372482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:48.378048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 149/308] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 07:57:48 2022] GET /identity/v3/role_assignments?user.id=a01dd302fe3b48c18ed5147e902d2e53&scope.system=all&role.id=918555c720174958942568d7b3913066 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:48.378824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.424151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634e5a0-6f80-4590-bb64-09e5bf393d5b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.464807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3ec73-e789-4d50-aa42-e25835ba31d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.465421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ec73-e789-4d50-aa42-e25835ba31d6 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.465691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ec73-e789-4d50-aa42-e25835ba31d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.466074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ec73-e789-4d50-aa42-e25835ba31d6 None admin] PATH_INFO: `/v3/groups` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.466699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3ec73-e789-4d50-aa42-e25835ba31d6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:48.468479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3ec73-e789-4d50-aa42-e25835ba31d6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:48.491458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 160/309] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 10 07:57:48 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:48.491458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aaedd-2a1e-4593-a4d9-41468373eacf None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.491458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aaedd-2a1e-4593-a4d9-41468373eacf None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.491458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aaedd-2a1e-4593-a4d9-41468373eacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.504852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9a526-117e-4606-b051-b03a34af1b81 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.517770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-957aaedd-2a1e-4593-a4d9-41468373eacf None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:48.518948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-957aaedd-2a1e-4593-a4d9-41468373eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:48.556579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.557366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.557644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.557919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] PATH_INFO: `/v3/users/8d94cc0ce64a4031b6ad70bafcb0f1e0` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.559355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] RBAC: Authorizing `identity:get_user(user_id=8d94cc0ce64a4031b6ad70bafcb0f1e0)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:48.560843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:48.567376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 150/310] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:48 2022] GET /identity/v3/users/8d94cc0ce64a4031b6ad70bafcb0f1e0 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:48.568696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.578871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:48.597283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:48.616612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 161/311] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:48.640932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aaedd-2a1e-4593-a4d9-41468373eacf None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.684873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da668-bb1f-41c0-baaa-a7edf070a904 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.728552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.729208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.729482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.729752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] PATH_INFO: `/v3/system/users/8d94cc0ce64a4031b6ad70bafcb0f1e0/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.731207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8d94cc0ce64a4031b6ad70bafcb0f1e0, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:48.732610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:48.751475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 151/312] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 10 07:57:48 2022] PUT /identity/v3/system/users/8d94cc0ce64a4031b6ad70bafcb0f1e0/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:57:48.785710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aaedd-2a1e-4593-a4d9-41468373eacf None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:48.828114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:48.828858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:48.829144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:48.829418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:48.841978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:48.847574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:48.848499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:48.849316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 162/313] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:48.855268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:48.931435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:48.965550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c223c-77de-49ba-9fee-9afc41334742 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:49.001306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:49.001914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.002191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.002465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.003131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:49.003449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:49.004847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:49.013144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 152/314] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:49.019444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:49.050724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:49.134439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484400e7-7512-4352-b2f9-2155be17b806 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:49.171525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:49.172328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.172606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.172879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] PATH_INFO: `/v3/users/437887dd7e21432f826f49513467a007` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.174029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] RBAC: Authorizing `identity:get_user(user_id=437887dd7e21432f826f49513467a007)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:49.175478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:49.177060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 163/315] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:49 2022] GET /identity/v3/users/437887dd7e21432f826f49513467a007 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:49.182501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:49.296437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e416ed6-6ea0-4884-88e6-2f5dc0d4c998 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:49.335882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:49.340097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:49.340608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.341212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.341481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.413044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:49.414502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:49.555555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 153/316] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:49.564795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:49.675740 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:49.682657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29364297-6f24-4117-8729-0cbb79d05b10 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:49.716731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ebb0e-5c11-4e71-89a9-abd019d25389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:49.717903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebb0e-5c11-4e71-89a9-abd019d25389 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.718171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebb0e-5c11-4e71-89a9-abd019d25389 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.718578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebb0e-5c11-4e71-89a9-abd019d25389 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.719757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ebb0e-5c11-4e71-89a9-abd019d25389 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:49.721307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ebb0e-5c11-4e71-89a9-abd019d25389 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:49.723218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 164/317] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:49 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:49.729515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:49.759669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:49.831673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f6fda-60ca-4c7d-9264-b09fe1f2734b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:49.867999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8ade3-eba8-45d5-a666-f45bebb5036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:49.868598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ade3-eba8-45d5-a666-f45bebb5036d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:49.868872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ade3-eba8-45d5-a666-f45bebb5036d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:49.869139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ade3-eba8-45d5-a666-f45bebb5036d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:49.869855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8ade3-eba8-45d5-a666-f45bebb5036d None admin] RBAC: Adding query filter params (role.id=918555c720174958942568d7b3913066, scope.project.id=10bafec90d23450dbc1d1f64870e5868, user.id=437887dd7e21432f826f49513467a007) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:49.870154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8ade3-eba8-45d5-a666-f45bebb5036d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:49.871609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8ade3-eba8-45d5-a666-f45bebb5036d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:49.878623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 154/318] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:57:49 2022] GET /identity/v3/role_assignments?user.id=437887dd7e21432f826f49513467a007&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=918555c720174958942568d7b3913066 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:50.465036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e5148-8eba-470c-9239-9482e0123ca0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.465445 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e5148-8eba-470c-9239-9482e0123ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.465624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e5148-8eba-470c-9239-9482e0123ca0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.467073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 165/319] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:50.472620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965477-49bd-4a43-8c78-81b840ffee18 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.472906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965477-49bd-4a43-8c78-81b840ffee18 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.473178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965477-49bd-4a43-8c78-81b840ffee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.490867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f6965477-49bd-4a43-8c78-81b840ffee18 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:50.492074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f6965477-49bd-4a43-8c78-81b840ffee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:50.565301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 155/320] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:50.587132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e5148-8eba-470c-9239-9482e0123ca0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:50.688856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e5148-8eba-470c-9239-9482e0123ca0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:50.723562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca136d-663d-4cb0-b0d9-868d21554c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:50.724186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca136d-663d-4cb0-b0d9-868d21554c09 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.724460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca136d-663d-4cb0-b0d9-868d21554c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.724726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca136d-663d-4cb0-b0d9-868d21554c09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.735324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca136d-663d-4cb0-b0d9-868d21554c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-43ca136d-663d-4cb0-b0d9-868d21554c09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:50.740015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:50.740878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:50.741678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:50.742880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 166/321] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:50.746916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6965477-49bd-4a43-8c78-81b840ffee18 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:50.755371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514043ba-ae83-4543-8e02-4d54162dce0a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.756126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514043ba-ae83-4543-8e02-4d54162dce0a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.756403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514043ba-ae83-4543-8e02-4d54162dce0a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.758250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 167/322] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:57:50.762909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2ec8-f79b-47dd-9879-b3377465e94c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.763182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2ec8-f79b-47dd-9879-b3377465e94c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.763480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2ec8-f79b-47dd-9879-b3377465e94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.776769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:50.784371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-293c2ec8-f79b-47dd-9879-b3377465e94c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:50.785687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-293c2ec8-f79b-47dd-9879-b3377465e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:50.807567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:50.859788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6965477-49bd-4a43-8c78-81b840ffee18 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:50.867083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 168/323] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:50.868356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edcda5-56d0-4d3c-9182-fb915c927631 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.868638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edcda5-56d0-4d3c-9182-fb915c927631 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.868909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edcda5-56d0-4d3c-9182-fb915c927631 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.870129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 169/324] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:50.875786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ccd12-7a78-4dc1-9b35-ba68fdd5d876 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.876064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ccd12-7a78-4dc1-9b35-ba68fdd5d876 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.876334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ccd12-7a78-4dc1-9b35-ba68fdd5d876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.895482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dd4ccd12-7a78-4dc1-9b35-ba68fdd5d876 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:50.896622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dd4ccd12-7a78-4dc1-9b35-ba68fdd5d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:50.901224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:50.901820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:50.902091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:50.902350 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:50.903004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:50.903297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:50.905631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:50.913611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 156/325] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:50.914406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:50.968684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 170/326] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:50.969824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ccd12-7a78-4dc1-9b35-ba68fdd5d876 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.005441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:51.017838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0dd78-2163-4091-b778-9fa32092b94f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.051595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.052211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.052490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.052691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:51.052808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.054137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:51.055873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:51.057420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 157/327] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:51.060383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.069331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ccd12-7a78-4dc1-9b35-ba68fdd5d876 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.102744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.103402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.103702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.103970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] PATH_INFO: `/v3/users/a01dd302fe3b48c18ed5147e902d2e53` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.105075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] RBAC: Authorizing `identity:get_user(user_id=a01dd302fe3b48c18ed5147e902d2e53)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:51.106489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:51.109057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 171/328] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:50 2022] GET /identity/v3/users/a01dd302fe3b48c18ed5147e902d2e53 => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:51.109758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.160592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77dc20-76aa-4391-af9a-561e4a63a84f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.194142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.194762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.195039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.195312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.205506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca6efb-ad03-41bd-bb85-dabd2fe85a18 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.205679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:51.210750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:51.211839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 158/329] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:51.213170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.234641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:51.239603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.240214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.240492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.240762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] PATH_INFO: `/v3/groups` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.241387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:51.242804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:51.257937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 172/330] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 10 07:57:51 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:57:51.258832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.275096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:51.334651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bcb04-a041-4d88-9af2-caf789d3a395 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.375163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.375865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.376178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.376454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] PATH_INFO: `/v3/system/users/a01dd302fe3b48c18ed5147e902d2e53/roles/918555c720174958942568d7b3913066` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.377952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a01dd302fe3b48c18ed5147e902d2e53, role_id=918555c720174958942568d7b3913066)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:51.379357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:51.381563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7847-971a-483b-9457-37f59aaf914e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.387871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 159/331] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 10 07:57:51 2022] PUT /identity/v3/system/users/a01dd302fe3b48c18ed5147e902d2e53/roles/918555c720174958942568d7b3913066 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:57:51.423937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.424804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.425232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.425649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.426493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:51.426944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:51.428550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:51.438939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 173/332] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:51.444867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.549494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:51.573980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c47c6-34f7-4b81-9884-5cab802ea535 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.611018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8d8c0-c6be-4ed7-8e4d-5b836f06156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.611688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d8c0-c6be-4ed7-8e4d-5b836f06156d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.611967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d8c0-c6be-4ed7-8e4d-5b836f06156d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.612287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d8c0-c6be-4ed7-8e4d-5b836f06156d None admin] PATH_INFO: `/v3/users/8d94cc0ce64a4031b6ad70bafcb0f1e0` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.613393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8d8c0-c6be-4ed7-8e4d-5b836f06156d None admin] RBAC: Authorizing `identity:get_user(user_id=8d94cc0ce64a4031b6ad70bafcb0f1e0)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:51.614867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8d8c0-c6be-4ed7-8e4d-5b836f06156d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:51.616758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 160/333] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:51 2022] GET /identity/v3/users/8d94cc0ce64a4031b6ad70bafcb0f1e0 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:51.622391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:51.715125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:51.744164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a569-6a31-429d-a7db-22f6c44a4966 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:51.784081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79d359-7754-4ca0-bdbc-e5d24fcbf295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:51.784699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79d359-7754-4ca0-bdbc-e5d24fcbf295 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:51.784976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79d359-7754-4ca0-bdbc-e5d24fcbf295 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:51.785246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79d359-7754-4ca0-bdbc-e5d24fcbf295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:51.785975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79d359-7754-4ca0-bdbc-e5d24fcbf295 None admin] RBAC: Adding query filter params (role.id=e606be389f29465393427b1abb34b098, user.id=8d94cc0ce64a4031b6ad70bafcb0f1e0, scope.system=all) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:51.786283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79d359-7754-4ca0-bdbc-e5d24fcbf295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:51.787751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79d359-7754-4ca0-bdbc-e5d24fcbf295 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:51.800744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 174/334] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 07:57:51 2022] GET /identity/v3/role_assignments?user.id=8d94cc0ce64a4031b6ad70bafcb0f1e0&scope.system=all&role.id=e606be389f29465393427b1abb34b098 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:53.644015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7014b3b-1c0c-4e53-ae62-3396564e24de None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:53.644512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7014b3b-1c0c-4e53-ae62-3396564e24de None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:53.644512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7014b3b-1c0c-4e53-ae62-3396564e24de None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:53.646114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 161/335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:53.651473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1640-2d42-4db8-88dd-ae92b0b89454 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:53.651889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1640-2d42-4db8-88dd-ae92b0b89454 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:53.652059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1640-2d42-4db8-88dd-ae92b0b89454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:53.676505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d00f1640-2d42-4db8-88dd-ae92b0b89454 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:53.678296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d00f1640-2d42-4db8-88dd-ae92b0b89454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:53.767229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 175/336] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:53.822102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7014b3b-1c0c-4e53-ae62-3396564e24de None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:53.937045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7014b3b-1c0c-4e53-ae62-3396564e24de None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:53.984486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:53.985132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:53.985412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:53.985682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:53.989961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ef72-5814-426d-957e-67446ecac794 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:53.990240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ef72-5814-426d-957e-67446ecac794 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:53.990510 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ef72-5814-426d-957e-67446ecac794 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:53.992145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 176/337] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:53.998715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594ad65-5ed8-454b-82a8-4b260e0266e8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:53.998996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594ad65-5ed8-454b-82a8-4b260e0266e8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:53.999264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594ad65-5ed8-454b-82a8-4b260e0266e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.008605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:54.015152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:54.016078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:54.016912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 162/338] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:54.023182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.032567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9594ad65-5ed8-454b-82a8-4b260e0266e8 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:54.033769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9594ad65-5ed8-454b-82a8-4b260e0266e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:54.043760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:54.160844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:54.192990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 177/339] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:54.224749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6cbc3-1a8f-43d4-b3ae-43e2c8398452 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:54.240111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594ad65-5ed8-454b-82a8-4b260e0266e8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.274071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:54.275050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.276826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.277302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.278175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:54.279469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:54.281335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:54.313146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 163/340] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:54.324455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.434285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:54.439315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594ad65-5ed8-454b-82a8-4b260e0266e8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:54.474418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90a864-1e88-44b2-a907-f637780d8172 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:54.481566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa45dac-3660-4087-b552-9b68e86396da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:54.482198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa45dac-3660-4087-b552-9b68e86396da None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.482470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa45dac-3660-4087-b552-9b68e86396da None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.483275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa45dac-3660-4087-b552-9b68e86396da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.496904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa45dac-3660-4087-b552-9b68e86396da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0fa45dac-3660-4087-b552-9b68e86396da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:54.503281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:54.504215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:54.505075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 178/341] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:54.506400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74b9b8-28ea-45d3-8349-6ace55bcf881 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.506677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74b9b8-28ea-45d3-8349-6ace55bcf881 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.508833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74b9b8-28ea-45d3-8349-6ace55bcf881 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.512734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 179/342] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:54.513941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74b9b8-28ea-45d3-8349-6ace55bcf881 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.528208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf02a5e-3d82-4664-b6b7-4dc4d355449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:54.529295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02a5e-3d82-4664-b6b7-4dc4d355449a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.529636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02a5e-3d82-4664-b6b7-4dc4d355449a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.529931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02a5e-3d82-4664-b6b7-4dc4d355449a None admin] PATH_INFO: `/v3/users/a01dd302fe3b48c18ed5147e902d2e53` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.531532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf02a5e-3d82-4664-b6b7-4dc4d355449a None admin] RBAC: Authorizing `identity:get_user(user_id=a01dd302fe3b48c18ed5147e902d2e53)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:54.533270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf02a5e-3d82-4664-b6b7-4dc4d355449a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:54.539439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 164/343] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/users/a01dd302fe3b48c18ed5147e902d2e53 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:54.539439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8862-91cb-4809-8a2f-36aa0d656655 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.539439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8862-91cb-4809-8a2f-36aa0d656655 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.539439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8862-91cb-4809-8a2f-36aa0d656655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.561688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7fde8862-91cb-4809-8a2f-36aa0d656655 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:54.563235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7fde8862-91cb-4809-8a2f-36aa0d656655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:54.587281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:54.642963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 165/344] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:54.643851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde8862-91cb-4809-8a2f-36aa0d656655 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.668876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74b9b8-28ea-45d3-8349-6ace55bcf881 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:54.731101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:54.732173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.733302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.733788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.734674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:54.735203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:54.736996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:54.747934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:54.753451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 180/345] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:54.755622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.788759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde8862-91cb-4809-8a2f-36aa0d656655 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:54.846338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:54.846338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:54.846338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:54.846338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:54.846744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] RBAC: Adding query filter params (role.id=918555c720174958942568d7b3913066, user.id=a01dd302fe3b48c18ed5147e902d2e53, scope.system=all) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:54.846744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:54.849039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:54.862150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 166/346] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/role_assignments?user.id=a01dd302fe3b48c18ed5147e902d2e53&scope.system=all&role.id=918555c720174958942568d7b3913066 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:54.863008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:54.990441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56907be-9315-4146-9515-faa990783bd1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:55.013578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042e24-074d-4fb1-ad02-a4488eb39591 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:55.022949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:55.060392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:55.076146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafefa4-e68f-4f59-8524-08464eae2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:55.077120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b65ab7-39ef-4519-8872-8007357ca71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:55.077546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafefa4-e68f-4f59-8524-08464eae2b60 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.077915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b65ab7-39ef-4519-8872-8007357ca71b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.078097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafefa4-e68f-4f59-8524-08464eae2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.078376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b65ab7-39ef-4519-8872-8007357ca71b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.078486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafefa4-e68f-4f59-8524-08464eae2b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.078743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b65ab7-39ef-4519-8872-8007357ca71b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.101534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b65ab7-39ef-4519-8872-8007357ca71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-f7b65ab7-39ef-4519-8872-8007357ca71b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:55.115833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:55.117569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:55.118440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 181/347] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:55.119118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596a217-999a-4200-a8bd-67bffd64d2de None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.119118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596a217-999a-4200-a8bd-67bffd64d2de None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.119850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596a217-999a-4200-a8bd-67bffd64d2de None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.122693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 182/348] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:55.140913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596a217-999a-4200-a8bd-67bffd64d2de None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:55.202960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafefa4-e68f-4f59-8524-08464eae2b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:55.204566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafefa4-e68f-4f59-8524-08464eae2b60 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:55.328124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596a217-999a-4200-a8bd-67bffd64d2de None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:55.380860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:55.381498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.381769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.382043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.382719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:55.383019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:55.384450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:55.390386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 167/349] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:55.392059 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527d8d-6484-456a-b89b-cbb930256fe6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.392565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527d8d-6484-456a-b89b-cbb930256fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.393389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527d8d-6484-456a-b89b-cbb930256fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.402897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 183/350] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:55.405093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:55.424098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1f527d8d-6484-456a-b89b-cbb930256fe6 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:55.426323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1f527d8d-6484-456a-b89b-cbb930256fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:55.455219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:55.464805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:55.538605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 168/351] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:55.541900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527d8d-6484-456a-b89b-cbb930256fe6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:55.568850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7173b5-8bf8-4d41-974a-aa3c0f4554f4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:55.637026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:55.637859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.638233 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.638610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.644119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:55.646827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:55.649852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 184/352] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:55 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:55.650987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:55.699391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527d8d-6484-456a-b89b-cbb930256fe6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:55.755634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251632f-d091-4422-b694-f2787df89b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:55.757458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251632f-d091-4422-b694-f2787df89b4e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.758000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251632f-d091-4422-b694-f2787df89b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.758403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251632f-d091-4422-b694-f2787df89b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.796894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:55.823030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38610-6d98-4e61-8b06-d69d13c80563 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:55.826695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:55.860827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251632f-d091-4422-b694-f2787df89b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:55.862304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251632f-d091-4422-b694-f2787df89b4e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:55.872792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:55.874681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.875198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.876001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.889752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:55.894690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:55.895639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:55.896454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 185/353] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:55.897120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:55.987988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 169/354] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:55.989559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e597b5-f540-4158-8a4b-352e6ce3b1f6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:55.989845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e597b5-f540-4158-8a4b-352e6ce3b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:55.990109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e597b5-f540-4158-8a4b-352e6ce3b1f6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:55.992473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 170/355] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:55.993179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e597b5-f540-4158-8a4b-352e6ce3b1f6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.029759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c327-b235-41b1-a6f8-e23f39fcf33c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.064865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:56.079325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.079924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.080193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.080466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.087009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:56.088878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:56.090857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 186/356] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:57:55 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:56.091648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.120808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e597b5-f540-4158-8a4b-352e6ce3b1f6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.124344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:56.160645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad8f1-3499-4032-9803-efcc8caa2145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.161408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad8f1-3499-4032-9803-efcc8caa2145 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.161787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad8f1-3499-4032-9803-efcc8caa2145 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.163366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad8f1-3499-4032-9803-efcc8caa2145 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.163366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad8f1-3499-4032-9803-efcc8caa2145 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:56.163366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad8f1-3499-4032-9803-efcc8caa2145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:56.164979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad8f1-3499-4032-9803-efcc8caa2145 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:56.174877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 171/357] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:56.177311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a58a4-bbbd-4f2f-9840-2b52e70f58e4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.177693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a58a4-bbbd-4f2f-9840-2b52e70f58e4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.178068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a58a4-bbbd-4f2f-9840-2b52e70f58e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.196595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a54a58a4-bbbd-4f2f-9840-2b52e70f58e4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:56.197806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a54a58a4-bbbd-4f2f-9840-2b52e70f58e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:56.221454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b461d6-e2b5-44b5-8d74-f1b7c35d4dc2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.261382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd39ee3-f8f0-42e4-b370-1ed01eef1937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.262007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd39ee3-f8f0-42e4-b370-1ed01eef1937 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.262286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd39ee3-f8f0-42e4-b370-1ed01eef1937 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.262546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd39ee3-f8f0-42e4-b370-1ed01eef1937 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.263733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd39ee3-f8f0-42e4-b370-1ed01eef1937 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:56.265172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd39ee3-f8f0-42e4-b370-1ed01eef1937 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:56.266812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 187/358] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:56.267990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4b36-93ad-4e8d-b4c1-739303ccf7b0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.268265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4b36-93ad-4e8d-b4c1-739303ccf7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.268530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4b36-93ad-4e8d-b4c1-739303ccf7b0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.269751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 188/359] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:56.270451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4b36-93ad-4e8d-b4c1-739303ccf7b0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.294868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 172/360] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:56.296570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a58a4-bbbd-4f2f-9840-2b52e70f58e4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.354544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:56.401860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:56.410257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4b36-93ad-4e8d-b4c1-739303ccf7b0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.423028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a58a4-bbbd-4f2f-9840-2b52e70f58e4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.447290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.447927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.448197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.448464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.449183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=e6e651f72afb4d498852b26955899a41) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:56.449488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:56.450917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:56.457709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 189/361] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:56.458805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.465012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.465636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.465912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.466180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.560061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:56.562622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:56.599894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25867bd-f93c-4a66-ae56-904e73150fac None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.623015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:56.645204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0f85f-4edb-46d7-94d1-3b60577d122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.646200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f85f-4edb-46d7-94d1-3b60577d122d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.646683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f85f-4edb-46d7-94d1-3b60577d122d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.647146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0f85f-4edb-46d7-94d1-3b60577d122d None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.648654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0f85f-4edb-46d7-94d1-3b60577d122d None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:56.650383 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0f85f-4edb-46d7-94d1-3b60577d122d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:56.652251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 190/362] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:56.653753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa83a5-0073-481a-bb03-a120f4f39926 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.654047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa83a5-0073-481a-bb03-a120f4f39926 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.654414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa83a5-0073-481a-bb03-a120f4f39926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.676916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4baa83a5-0073-481a-bb03-a120f4f39926 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:56.678302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4baa83a5-0073-481a-bb03-a120f4f39926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:56.693707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 173/363] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:56.693707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.712845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:56.769675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 191/364] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:56.770990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa83a5-0073-481a-bb03-a120f4f39926 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.833299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b760f-4e34-49bd-9844-061083d2c10a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.878175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.878723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.878993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.879258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.894932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:56.902488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:56.904038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:56.905580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:56.907974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 174/365] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:56.909162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:56.915624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa83a5-0073-481a-bb03-a120f4f39926 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:56.925180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:56.958989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:56.959625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:56.960343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:56.960343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:56.960870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=e606be389f29465393427b1abb34b098, scope.project.id=e6e651f72afb4d498852b26955899a41) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:56.961175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:56.962615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:56.975716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 192/366] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=e606be389f29465393427b1abb34b098 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:56.976777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.015185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.055565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f6de-93d2-4d62-a0ea-a62298a7378d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.094928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.095597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.095869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.096137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.097312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:57.098778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:57.100867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 175/367] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:57.102165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.116518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e848e6-7ab1-44d8-b37a-13c155c7c2a8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.157310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.158347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.158632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.158908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.171789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:57.178130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:57.179037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:57.179859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 193/368] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:57.180509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.189057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.215855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7aac7-a61a-4123-a170-3b7ca187d5a1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.255816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.256468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.256745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.257013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.257674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:57.257966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:57.259331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:57.270769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 176/369] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:57.271634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.301254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.317466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93f925-f31b-4a7e-be96-fc0944f20c90 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.363693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.364630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.365819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.366096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.367233 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:57.368713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:57.371265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 194/370] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:57.372128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.405534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10da46-2e4a-4262-aa31-da6c0a105c77 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.444762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.445289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.445561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.445829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.446482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:57.446777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:57.449177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:57.455034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.463709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 177/371] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:57.465004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.508775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69327e-df5b-443d-a713-b5cc10240742 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.568949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.570036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.570595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.571184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.611009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.631949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17d46-5718-4ff0-a67e-9292b31c9918 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.697742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.698988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.699681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.700309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:57.702373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=e606be389f29465393427b1abb34b098, scope.project.id=10bafec90d23450dbc1d1f64870e5868) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:57.702912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:57.706852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:57.716802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 178/372] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=e606be389f29465393427b1abb34b098 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:57.718211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.720275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:57.721944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:57.852807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 195/373] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:57.861261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:57.886941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.941940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c133cc-e685-401d-a0a1-40d10614737a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:57.961978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:57.986665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:57.987285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:57.987608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:57.988048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:58.062730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b20278-f8bd-4efa-85b3-464978ab760e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:58.091403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:58.094068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:58.139833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:58.140473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:58.140807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:58.141082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:58.142249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:58.143667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:58.145447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 196/374] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:58.174612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:58.176445 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:58.225408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 179/375] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:57:58.230958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:58.416051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc3f8-986f-4a9d-a36f-5d414aa4c7fb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:58.430225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafa762-5b6f-4c83-8025-1440f04fa316 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:58.461174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:58.461810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:58.462221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:58.462490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] PATH_INFO: `/v3/projects/f1162a60112e4fd8987d9e032506b0a6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:58.463872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] RBAC: Authorizing `identity:get_project(project_id=f1162a60112e4fd8987d9e032506b0a6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:58.465381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:58.467460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 180/376] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:58 2022] GET /identity/v3/projects/f1162a60112e4fd8987d9e032506b0a6 => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:58.469528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:58.476841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:58.490629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:58.491256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:58.493479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:58.493763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:58.494909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:58.496368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:58.498804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 197/377] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:57:58 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:58.506143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:58.520028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:58.599751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85182608-20a2-4e8f-8f62-d6f907987f98 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:58.640512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:58.641161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:58.641436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:58.641705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] PATH_INFO: `/v3/groups/446d0fb22aec4d3bad71e478303d8be2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:58.648363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] RBAC: Authorizing `identity:get_group(group_id=446d0fb22aec4d3bad71e478303d8be2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:58.649835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:58.651774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 181/378] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:57:58 2022] GET /identity/v3/groups/446d0fb22aec4d3bad71e478303d8be2 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:58.657958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:58.687352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dafaa4-c780-41cc-9e32-49f5bcdb4cb0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:58.766454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa44b98-f7e3-4063-9dff-5b010f69496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:58.766985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44b98-f7e3-4063-9dff-5b010f69496d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:58.767253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44b98-f7e3-4063-9dff-5b010f69496d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:58.771441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44b98-f7e3-4063-9dff-5b010f69496d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:58.772195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44b98-f7e3-4063-9dff-5b010f69496d None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=10bafec90d23450dbc1d1f64870e5868) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:58.772506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44b98-f7e3-4063-9dff-5b010f69496d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:58.774017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44b98-f7e3-4063-9dff-5b010f69496d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:58.788217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 198/379] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:57:58 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:58.830467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:58.839449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0a45d-891b-4c21-bb81-bc9d8df740bc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:58.880425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b4af6-bdef-4801-bbd2-e332a39e62a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:58.881030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b4af6-bdef-4801-bbd2-e332a39e62a7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:58.881300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b4af6-bdef-4801-bbd2-e332a39e62a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:58.881566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b4af6-bdef-4801-bbd2-e332a39e62a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:58.882285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b4af6-bdef-4801-bbd2-e332a39e62a7 None admin] RBAC: Adding query filter params (group.id=446d0fb22aec4d3bad71e478303d8be2, role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=f1162a60112e4fd8987d9e032506b0a6) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:58.882585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b4af6-bdef-4801-bbd2-e332a39e62a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:58.884057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b4af6-bdef-4801-bbd2-e332a39e62a7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:58.890245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 182/380] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:57:58 2022] GET /identity/v3/role_assignments?group.id=446d0fb22aec4d3bad71e478303d8be2&scope.project.id=f1162a60112e4fd8987d9e032506b0a6&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:57:58.999380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de64e0-4348-4f57-bcd2-b309cc0df0cb None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.000169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de64e0-4348-4f57-bcd2-b309cc0df0cb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.000169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de64e0-4348-4f57-bcd2-b309cc0df0cb None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.001334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 199/381] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:59.013014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2272416-e434-487a-9013-802cc572399d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.013332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2272416-e434-487a-9013-802cc572399d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.014250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2272416-e434-487a-9013-802cc572399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.039893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a2272416-e434-487a-9013-802cc572399d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:59.041109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2272416-e434-487a-9013-802cc572399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:59.129977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 183/382] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:57:59.153506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de64e0-4348-4f57-bcd2-b309cc0df0cb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:59.219601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:59.258352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55b0a-c5ff-424e-966c-1f3422a8ed0e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.258695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55b0a-c5ff-424e-966c-1f3422a8ed0e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.258906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55b0a-c5ff-424e-966c-1f3422a8ed0e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.260544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 184/383] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:57:59.266191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9e2d5-292f-42d7-9aae-3d108c75bd5e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.266470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9e2d5-292f-42d7-9aae-3d108c75bd5e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.266736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9e2d5-292f-42d7-9aae-3d108c75bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.285614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de64e0-4348-4f57-bcd2-b309cc0df0cb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:59.310053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-07e9e2d5-292f-42d7-9aae-3d108c75bd5e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:57:59.311808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-07e9e2d5-292f-42d7-9aae-3d108c75bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:57:59.324780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:59.325419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.325695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.325968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.337742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:59.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:59.343893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:57:59.344961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 200/384] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:57:59.351556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:59.470575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832e60f-eb58-4e33-addb-36b8852cfd60 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:59.481128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 185/385] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:57:59.489522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:59.522359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:59.523226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.523684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.524113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.524920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:57:59.525365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:59.526862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:59.528720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9e2d5-292f-42d7-9aae-3d108c75bd5e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:59.539721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 201/386] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:59.552245 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:59.578481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:59.689797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f02c-28fa-4cdf-877b-3396706f0fdf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:59.736223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:59.737226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.737573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.737852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.743104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:57:59.744599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:57:59.746680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 202/387] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:57:59 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:57:59.752228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:59.761690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9e2d5-292f-42d7-9aae-3d108c75bd5e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:57:59.802413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:57:59.803308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:57:59.804716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:57:59.809608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:57:59.829211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:57:59.834785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:57:59.835961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:57:59.837005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:57:59.846954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 186/388] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:57:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:57:59.853469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:57:59.855869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:59.954463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:57:59.964213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4699f-1fe7-49ce-a460-3289b4e897ec None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:00.002018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:00.002897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.003340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.003955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.004887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:00.005344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:00.006938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:00.017307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 187/389] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:57:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:00.021586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfecd85-7bb5-493c-be6b-a49edcb01f8a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:00.024335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:00.099322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:00.100239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.100716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.101142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.104588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:00.106258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:00.109284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 203/390] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:57:59 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:00.113694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:00.253292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30724258-3c4d-4e0c-b1d8-b51c5a501b42 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:00.253716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b3f75-5a5b-404d-8ffa-8fbf3b8099dd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:00.264801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:00.298894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:00.300469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.300901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.301330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.304048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6e651f72afb4d498852b26955899a41, group_id=fa9e77d7514a49bca2dc21198dbbc66e, role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:00.306360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:00.323034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 204/391] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 07:58:00 2022] PUT /identity/v3/projects/e6e651f72afb4d498852b26955899a41/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/d4924cc22b334ebe9f07b5938e64913b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:58:00.344156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:00.345068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.345573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.345993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.347501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:00.349164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:00.351448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 188/392] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:00 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:00.356950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:00.474371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cca134-b399-418d-ae78-c86dfb7ada27 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:00.518019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2517a2-b54a-41fa-90f4-2a481a279904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:00.518991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2517a2-b54a-41fa-90f4-2a481a279904 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.519466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2517a2-b54a-41fa-90f4-2a481a279904 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.520177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2517a2-b54a-41fa-90f4-2a481a279904 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.521541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2517a2-b54a-41fa-90f4-2a481a279904 None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:00.523141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2517a2-b54a-41fa-90f4-2a481a279904 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:00.525079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 205/393] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:00 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:00.531104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:00.556025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:00.567015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20693020-7fdc-444e-8c9a-54abb675e638 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.567581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20693020-7fdc-444e-8c9a-54abb675e638 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.567991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20693020-7fdc-444e-8c9a-54abb675e638 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.570702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 206/394] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:00.577494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63307a-2ed0-4f42-a891-066b58cfcf32 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.577899 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63307a-2ed0-4f42-a891-066b58cfcf32 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.578174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63307a-2ed0-4f42-a891-066b58cfcf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.602627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6e63307a-2ed0-4f42-a891-066b58cfcf32 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:00.604368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6e63307a-2ed0-4f42-a891-066b58cfcf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:00.641224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:00.686173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ab79-a5e2-4928-a4bb-cf68ad39b9f9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:00.689689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 207/395] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:00.716389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63307a-2ed0-4f42-a891-066b58cfcf32 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:00.749386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:00.750272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.750512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.750782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.753972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6e651f72afb4d498852b26955899a41, group_id=fa9e77d7514a49bca2dc21198dbbc66e, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:00.755438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:00.778717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 189/396] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 07:58:00 2022] PUT /identity/v3/projects/e6e651f72afb4d498852b26955899a41/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:00.878888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63307a-2ed0-4f42-a891-066b58cfcf32 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:00.936251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:00.937174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:00.937589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:00.938029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:00.957440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:00.966154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:00.967452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:58:00.968529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:00.970534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 208/397] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:00.976307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:01.053483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:01.098139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfa4f0-4f05-4dec-b169-354d2874e1d7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:01.157124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d162f-2d2f-40d6-882f-dda221f5039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:01.157967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d162f-2d2f-40d6-882f-dda221f5039c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.158386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d162f-2d2f-40d6-882f-dda221f5039c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.158816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d162f-2d2f-40d6-882f-dda221f5039c None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.159693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d162f-2d2f-40d6-882f-dda221f5039c None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:01.160144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d162f-2d2f-40d6-882f-dda221f5039c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:01.161712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d162f-2d2f-40d6-882f-dda221f5039c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:01.175793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 190/398] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:58:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:01.181416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:01.222834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:01.291081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975ea9c-a01a-4be5-943f-34c9c6b8de82 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.291429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975ea9c-a01a-4be5-943f-34c9c6b8de82 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.291675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975ea9c-a01a-4be5-943f-34c9c6b8de82 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.293302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 191/399] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:01.299165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b694a-1734-4a22-a7a7-06febaee27ae None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.299490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b694a-1734-4a22-a7a7-06febaee27ae None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.299757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b694a-1734-4a22-a7a7-06febaee27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.324802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1d1b694a-1734-4a22-a7a7-06febaee27ae None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:01.326724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1d1b694a-1734-4a22-a7a7-06febaee27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:01.343308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beb872-330d-4d6d-b5ee-fbba0c5a90d7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:01.404670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:01.405310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.405587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.405856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.407062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:01.408594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:01.410289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 209/400] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:01 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:01.415536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:01.459530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 192/401] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:01.493841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b694a-1734-4a22-a7a7-06febaee27ae None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:01.582736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:01.584328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:01.602192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d5a75-c0b5-4c1c-ba48-cecbfefbb99a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:01.638184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b694a-1734-4a22-a7a7-06febaee27ae None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:01.650474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c202cc2-72fe-461a-8b95-e6dd21274da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:01.651114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c202cc2-72fe-461a-8b95-e6dd21274da4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.651395 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c202cc2-72fe-461a-8b95-e6dd21274da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.651712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c202cc2-72fe-461a-8b95-e6dd21274da4 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.652960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c202cc2-72fe-461a-8b95-e6dd21274da4 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:01.655290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c202cc2-72fe-461a-8b95-e6dd21274da4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:01.657370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 210/402] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:01 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:01.658700 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2750d8-6281-4d60-bbdc-e2bbf9ee7963 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.658928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2750d8-6281-4d60-bbdc-e2bbf9ee7963 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.659203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2750d8-6281-4d60-bbdc-e2bbf9ee7963 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.660456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 211/403] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:01.665293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2750d8-6281-4d60-bbdc-e2bbf9ee7963 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:01.679545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c535d8f-c7ed-4287-868e-0469aa841662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:01.680342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535d8f-c7ed-4287-868e-0469aa841662 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.680775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535d8f-c7ed-4287-868e-0469aa841662 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.681048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535d8f-c7ed-4287-868e-0469aa841662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.697448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c535d8f-c7ed-4287-868e-0469aa841662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-1c535d8f-c7ed-4287-868e-0469aa841662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:01.704502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:01.705431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:01.706220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:01.707941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 193/404] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:01.708761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d302cf-756c-4cad-b9af-126af6a93c28 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.709042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d302cf-756c-4cad-b9af-126af6a93c28 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.709317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d302cf-756c-4cad-b9af-126af6a93c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.732750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-18d302cf-756c-4cad-b9af-126af6a93c28 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:01.733967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-18d302cf-756c-4cad-b9af-126af6a93c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:01.805353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2750d8-6281-4d60-bbdc-e2bbf9ee7963 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:01.815526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 194/405] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:01.816492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d302cf-756c-4cad-b9af-126af6a93c28 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:01.846493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:01.847370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:01.848068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:01.848419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:01.850394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] RBAC: Authorizing `identity:create_grant(project_id=10bafec90d23450dbc1d1f64870e5868, group_id=fa9e77d7514a49bca2dc21198dbbc66e, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:01.852737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:01.870344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 212/406] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 07:58:01 2022] PUT /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:01.871978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:01.889939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:01.911099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:01.976137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d302cf-756c-4cad-b9af-126af6a93c28 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.020300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.021771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.022252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.022740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.023717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:02.024219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:02.026460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:02.037231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 195/407] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:02.046202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:02.055006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b822-13f9-4169-8261-9c61ba81ca77 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.141065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.141775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.142061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.143070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.153796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:02.159953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:02.160867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:02.162389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 213/408] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:02.167462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:02.186511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e14ed-1a16-4e1d-8bf9-1e197444a75c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.208882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:02.241294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170f43-e445-4588-becf-912206fcd077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.242566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170f43-e445-4588-becf-912206fcd077 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.243299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170f43-e445-4588-becf-912206fcd077 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.244231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170f43-e445-4588-becf-912206fcd077 None admin] PATH_INFO: `/v3/groups/446d0fb22aec4d3bad71e478303d8be2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.246040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170f43-e445-4588-becf-912206fcd077 None admin] RBAC: Authorizing `identity:get_group(group_id=446d0fb22aec4d3bad71e478303d8be2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:02.248710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170f43-e445-4588-becf-912206fcd077 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:02.251850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 196/409] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:02 2022] GET /identity/v3/groups/446d0fb22aec4d3bad71e478303d8be2 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:02.259215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170f43-e445-4588-becf-912206fcd077 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:02.275547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:02.321563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d16d-480b-44de-97c5-fe97fa18713e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.393433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170f43-e445-4588-becf-912206fcd077 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.397187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.397803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.398083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.398357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.399028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:02.399330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:02.400739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:02.423610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 214/410] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:02.429380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:02.445865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.446829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.447308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.447845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] PATH_INFO: `/v3/projects/f1162a60112e4fd8987d9e032506b0a6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.450694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] RBAC: Authorizing `identity:get_project(project_id=f1162a60112e4fd8987d9e032506b0a6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:02.452943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:02.456449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 197/411] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:02 2022] GET /identity/v3/projects/f1162a60112e4fd8987d9e032506b0a6 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:02.483475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:02.543522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:02.631452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c792-bca6-4218-aaf8-e22056153f5b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.657657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec38b8-7290-4635-ab59-bf6cb7ad109f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.678334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7f354-788f-4a7d-aa14-1632e4320606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.679356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f354-788f-4a7d-aa14-1632e4320606 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.679862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f354-788f-4a7d-aa14-1632e4320606 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.680404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f354-788f-4a7d-aa14-1632e4320606 None admin] PATH_INFO: `/v3/projects/f1162a60112e4fd8987d9e032506b0a6/groups/446d0fb22aec4d3bad71e478303d8be2/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.688362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7f354-788f-4a7d-aa14-1632e4320606 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1162a60112e4fd8987d9e032506b0a6, group_id=446d0fb22aec4d3bad71e478303d8be2, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:02.690294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7f354-788f-4a7d-aa14-1632e4320606 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:02.695206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.696122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.696633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.696820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.698401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:02.700451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:02.703804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 215/412] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:02 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:02.709266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:02.710805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 198/413] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 07:58:02 2022] PUT /identity/v3/projects/f1162a60112e4fd8987d9e032506b0a6/groups/446d0fb22aec4d3bad71e478303d8be2/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:58:02.730250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:02.744538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b0c8-7a62-487b-8d72-2b837546cfef None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.745161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b0c8-7a62-487b-8d72-2b837546cfef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.745690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b0c8-7a62-487b-8d72-2b837546cfef None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.751314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 199/414] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:02.753076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c4d9-97d7-4012-8f90-e99ff247256a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.753684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c4d9-97d7-4012-8f90-e99ff247256a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.754197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c4d9-97d7-4012-8f90-e99ff247256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.791062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4bb7c4d9-97d7-4012-8f90-e99ff247256a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:02.792628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4bb7c4d9-97d7-4012-8f90-e99ff247256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:02.835327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda25d72-25df-41ab-bf28-a45114777ec8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:02.920254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:02.921360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:02.921847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:02.922349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:02.926184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:02.928020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:02.930082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 216/415] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:02 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:02.937131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:02.955605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 200/416] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:02.982286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c4d9-97d7-4012-8f90-e99ff247256a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:03.041681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:03.063781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:03.101194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a65a-93e6-473f-9412-0d9b92b1ea9c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:03.158955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40a2d7-04cb-4de6-98ff-f9d105d93915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:03.159642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40a2d7-04cb-4de6-98ff-f9d105d93915 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.159921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40a2d7-04cb-4de6-98ff-f9d105d93915 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.162940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40a2d7-04cb-4de6-98ff-f9d105d93915 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.167035 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40a2d7-04cb-4de6-98ff-f9d105d93915 None admin] RBAC: Authorizing `identity:create_grant(project_id=10bafec90d23450dbc1d1f64870e5868, group_id=fa9e77d7514a49bca2dc21198dbbc66e, role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:03.171914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c4d9-97d7-4012-8f90-e99ff247256a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:03.173377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40a2d7-04cb-4de6-98ff-f9d105d93915 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:03.193136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 217/417] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 07:58:02 2022] PUT /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868/groups/fa9e77d7514a49bca2dc21198dbbc66e/roles/d4924cc22b334ebe9f07b5938e64913b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:03.232021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e464f-9360-458a-beee-61e2453122bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:03.232910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e464f-9360-458a-beee-61e2453122bd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.233333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e464f-9360-458a-beee-61e2453122bd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.233705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e464f-9360-458a-beee-61e2453122bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.255389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e464f-9360-458a-beee-61e2453122bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-513e464f-9360-458a-beee-61e2453122bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:03.260496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:03.261855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:03.263057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 201/418] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:03.265531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b365ce-0cc8-459a-9654-e8dce0a7e62d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.265820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b365ce-0cc8-459a-9654-e8dce0a7e62d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.266097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b365ce-0cc8-459a-9654-e8dce0a7e62d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.267958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 218/419] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:03.268371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e464f-9360-458a-beee-61e2453122bd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:03.273630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3dbd-9218-4825-914c-8dae4d7b90c1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.273960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3dbd-9218-4825-914c-8dae4d7b90c1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.274243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3dbd-9218-4825-914c-8dae4d7b90c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.312718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-226a3dbd-9218-4825-914c-8dae4d7b90c1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:03.314771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-226a3dbd-9218-4825-914c-8dae4d7b90c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:03.397181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 219/420] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:03.422029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a3dbd-9218-4825-914c-8dae4d7b90c1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:03.472101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:03.477118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e464f-9360-458a-beee-61e2453122bd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:03.538078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:03.538688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.538960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.539227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.539923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:03.540223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:03.541599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:03.544846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:03.562707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 202/421] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:03.568634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:03.582121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a3dbd-9218-4825-914c-8dae4d7b90c1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:03.619045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:03.619742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.620025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.620301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.631700 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:03.636815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:03.637752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:03.639120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 220/422] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:03.644943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:03.734166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a459-3d72-42cf-bf9a-7dc6e76727f0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:03.774762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:03.775750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.777260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.777894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.838527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:03.867214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e56e6f-4ca8-498b-95f2-9b211809f480 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:03.909036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:03.913703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:03.929714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:03.937341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:03.938014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:03.938293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:03.938566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:03.940617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:03.940927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:03.942586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:03.957943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 221/423] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:03.968661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.120143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9415-83ad-4dc7-bf87-2cac6c4adc67 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:04.136296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 203/424] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:04.141755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.157285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:04.158003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.158343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.158683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.223243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:04.235184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:04.237017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:04.313093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:04.340012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 222/425] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:04.352417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.399377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe369-708e-49ed-ad01-a4f67f3f54d7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:04.446159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:04.457594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af342a1-e828-431e-9a2a-6bf4d9849d83 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:04.490949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6e705-e7fc-45ad-8119-106600b0b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:04.491637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6e705-e7fc-45ad-8119-106600b0b56f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.491910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6e705-e7fc-45ad-8119-106600b0b56f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.492175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6e705-e7fc-45ad-8119-106600b0b56f None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.493312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6e705-e7fc-45ad-8119-106600b0b56f None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:04.494814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6e705-e7fc-45ad-8119-106600b0b56f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:04.496732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 204/426] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:04.498122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512324-4688-47db-bf6f-37b63334d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:04.498361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401d423-b56d-474a-8afa-a038c028860a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.498639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401d423-b56d-474a-8afa-a038c028860a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.498906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401d423-b56d-474a-8afa-a038c028860a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.499713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512324-4688-47db-bf6f-37b63334d6eb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.500190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512324-4688-47db-bf6f-37b63334d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.504353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 205/427] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:04.504841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512324-4688-47db-bf6f-37b63334d6eb None admin] PATH_INFO: `/v3/projects/e6e651f72afb4d498852b26955899a41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.505266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401d423-b56d-474a-8afa-a038c028860a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.506501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512324-4688-47db-bf6f-37b63334d6eb None admin] RBAC: Authorizing `identity:get_project(project_id=e6e651f72afb4d498852b26955899a41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:04.508160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512324-4688-47db-bf6f-37b63334d6eb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:04.509915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 223/428] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/projects/e6e651f72afb4d498852b26955899a41 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:04.511406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47504-6441-4848-b5ca-a15848a9a6f1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.511922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47504-6441-4848-b5ca-a15848a9a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.512602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47504-6441-4848-b5ca-a15848a9a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.533392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-36a47504-6441-4848-b5ca-a15848a9a6f1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:04.535037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-36a47504-6441-4848-b5ca-a15848a9a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:04.618489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 224/429] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:04.619518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47504-6441-4848-b5ca-a15848a9a6f1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.631255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401d423-b56d-474a-8afa-a038c028860a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:04.676084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:04.677522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.677800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.678072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.679199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:04.679646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:04.684105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:04.687114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 206/430] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:04.688148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.737222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:04.746855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47504-6441-4848-b5ca-a15848a9a6f1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:04.782603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:04.783040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.783391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.783749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.784922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:04.786434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:04.788126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 225/431] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:04.789007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.809258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8535d-8c75-4cf2-8d31-1d82c16e0cfa None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:04.845897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:04.846815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.847373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.847950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.859857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:04.865503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:04.866417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 07:58:04.867212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:04.869667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 207/432] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:04.870572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:04.904701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd55f6-22d3-4a0e-9d63-58194e418632 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:04.947774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:04.948889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:04.949321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:04.949743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:04.951257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=e6e651f72afb4d498852b26955899a41) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:04.952055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:04.953823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:04.954049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:04.962307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 226/433] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:04.963333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:05.000131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:05.025624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bdae9-c69c-4121-8974-c2e52da1ed19 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:05.100337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:05.102522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.102806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.103077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.105616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=e606be389f29465393427b1abb34b098, scope.project.id=e6e651f72afb4d498852b26955899a41) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:05.105933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:05.107530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:05.128177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 208/434] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=e6e651f72afb4d498852b26955899a41&role.id=e606be389f29465393427b1abb34b098 => generated 611 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:05.150642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60bd08-f2d9-4f5c-a115-276dc585c655 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:05.189255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cea2fa-4b87-48fa-9d8e-2d23018a56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:05.189881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea2fa-4b87-48fa-9d8e-2d23018a56cd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.190159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea2fa-4b87-48fa-9d8e-2d23018a56cd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.190428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea2fa-4b87-48fa-9d8e-2d23018a56cd None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.191118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cea2fa-4b87-48fa-9d8e-2d23018a56cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:05.191435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cea2fa-4b87-48fa-9d8e-2d23018a56cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:05.192816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cea2fa-4b87-48fa-9d8e-2d23018a56cd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:05.207123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 227/435] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:58:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:05.209609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:05.302897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de599-0f4e-4495-8071-f1c1d11f6d64 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.302897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de599-0f4e-4495-8071-f1c1d11f6d64 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.302897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de599-0f4e-4495-8071-f1c1d11f6d64 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.303851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 228/436] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:05.311011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664efb2c-2c83-4996-b1c1-d2240fd977c1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.311314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664efb2c-2c83-4996-b1c1-d2240fd977c1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.311597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664efb2c-2c83-4996-b1c1-d2240fd977c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.331852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182d1b-3df7-4bb9-9e13-9f4443849602 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:05.333322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-664efb2c-2c83-4996-b1c1-d2240fd977c1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:05.335470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-664efb2c-2c83-4996-b1c1-d2240fd977c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:05.356555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:05.369718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:05.370427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.370915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.371148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.419438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 229/437] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:05.440955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664efb2c-2c83-4996-b1c1-d2240fd977c1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:05.448536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:05.450201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:05.459890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:05.572663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664efb2c-2c83-4996-b1c1-d2240fd977c1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:05.587810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 209/438] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:05.594131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:05.624796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:05.628387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:05.629605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.629605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.629773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.645185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:05.650639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:05.651752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:05.652682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 230/439] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:05.658717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:05.723589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3838-3842-45e3-a465-7f97ee65e492 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:05.748823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:05.762907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da969f14-a404-4a32-bbd7-d38cf194ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:05.763700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da969f14-a404-4a32-bbd7-d38cf194ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.763979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da969f14-a404-4a32-bbd7-d38cf194ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.764251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da969f14-a404-4a32-bbd7-d38cf194ad4f None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.767355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da969f14-a404-4a32-bbd7-d38cf194ad4f None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:05.767876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da969f14-a404-4a32-bbd7-d38cf194ad4f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:05.769973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 210/440] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:05 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:05.770656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861339f-b95c-47e5-b8bd-906bf9379911 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.773375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861339f-b95c-47e5-b8bd-906bf9379911 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.773375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861339f-b95c-47e5-b8bd-906bf9379911 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.773564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 211/441] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:05.775972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861339f-b95c-47e5-b8bd-906bf9379911 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:05.781725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96314b0-3a64-4087-aa70-b059d10ac52d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:05.824503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58f64c-6f14-43e2-b113-3cd525e81d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:05.825115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58f64c-6f14-43e2-b113-3cd525e81d70 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.825392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58f64c-6f14-43e2-b113-3cd525e81d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.825691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58f64c-6f14-43e2-b113-3cd525e81d70 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.826537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58f64c-6f14-43e2-b113-3cd525e81d70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:05.826838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58f64c-6f14-43e2-b113-3cd525e81d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:05.828248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58f64c-6f14-43e2-b113-3cd525e81d70 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:05.838718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 231/442] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:05.840121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747333-b46d-4949-81b3-1fbbcf0bca01 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.840407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747333-b46d-4949-81b3-1fbbcf0bca01 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.840685 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747333-b46d-4949-81b3-1fbbcf0bca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.859401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3e747333-b46d-4949-81b3-1fbbcf0bca01 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:05.860608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3e747333-b46d-4949-81b3-1fbbcf0bca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:05.880970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:05.891493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861339f-b95c-47e5-b8bd-906bf9379911 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:05.925397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:05.925566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 232/443] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:05.926012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:05.926263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747333-b46d-4949-81b3-1fbbcf0bca01 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:05.926359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:05.926532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:05.927655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:05.929077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:05.930600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 212/444] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:05 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:05.936853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.003742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:06.035622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa7e9-ba0a-41b4-a1ed-440f7b35f43b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.037760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747333-b46d-4949-81b3-1fbbcf0bca01 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.068525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.069116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.069392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.069656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.070362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=e606be389f29465393427b1abb34b098, scope.project.id=10bafec90d23450dbc1d1f64870e5868) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:06.070658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.072092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.073534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.074292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.074975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.075273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.078533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 213/445] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:58:05 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=e606be389f29465393427b1abb34b098 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:06.079298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.124378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:06.159189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.160737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.214751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd909-f3d6-4f1d-a669-5a3692948973 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.235515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:06.259483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.259941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.260223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.260497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.273170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:06.277958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 233/446] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:06.278375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:06.279329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:06.287949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 214/447] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:06.288615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.288686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.387456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:06.411154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611762-8e27-48b2-99cb-bf5efda12cf9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.420620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190a5f-d7e8-4af9-8dfc-6185f4ebca9d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.447867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.448472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.448747 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.449016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.449670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:06.449963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.452067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.457236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.457858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.458135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.458406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] PATH_INFO: `/v3/projects/f1162a60112e4fd8987d9e032506b0a6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.459564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] RBAC: Authorizing `identity:get_project(project_id=f1162a60112e4fd8987d9e032506b0a6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.460060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 215/448] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:06.461115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.463455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 234/449] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/projects/f1162a60112e4fd8987d9e032506b0a6 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:06.465340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.468591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.503241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:06.564561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908e22-8f7c-45bc-bfeb-029d2a44b90d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.569900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128884e-32e0-4e27-ad75-890975def60b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.596971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.597570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.597849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.598119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.601820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.602434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.602706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.602971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] PATH_INFO: `/v3/groups/446d0fb22aec4d3bad71e478303d8be2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.604085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] RBAC: Authorizing `identity:get_group(group_id=446d0fb22aec4d3bad71e478303d8be2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.605508 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.608244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 235/450] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/groups/446d0fb22aec4d3bad71e478303d8be2 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:06.612443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:06.613791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.669016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.670637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.712811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92a99-361b-4602-a189-230760b3eb40 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.714333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:06.747337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.748529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.748806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.749082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.749805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] RBAC: Adding query filter params (group.id=446d0fb22aec4d3bad71e478303d8be2, role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=f1162a60112e4fd8987d9e032506b0a6) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:06.750113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.751555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.757333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 236/451] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/role_assignments?group.id=446d0fb22aec4d3bad71e478303d8be2&scope.project.id=f1162a60112e4fd8987d9e032506b0a6&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:06.770622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 216/452] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:06.776496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.882258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ce0d-e111-423b-a70b-aa04164d9885 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:06.918175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:06.918805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:06.919086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:06.919397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] PATH_INFO: `/v3/projects/10bafec90d23450dbc1d1f64870e5868` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:06.921179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] RBAC: Authorizing `identity:get_project(project_id=10bafec90d23450dbc1d1f64870e5868)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:06.922623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:06.924277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 237/453] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/projects/10bafec90d23450dbc1d1f64870e5868 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:06.929868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:06.979785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:07.033565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9600a86-7d1e-4d8d-a6e1-b68eec21f7a5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:07.066532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46b12-4da4-4a88-bb02-9902ab20e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:07.067172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46b12-4da4-4a88-bb02-9902ab20e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:07.067468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46b12-4da4-4a88-bb02-9902ab20e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:07.067739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46b12-4da4-4a88-bb02-9902ab20e5c3 None admin] PATH_INFO: `/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:07.068829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d46b12-4da4-4a88-bb02-9902ab20e5c3 None admin] RBAC: Authorizing `identity:get_group(group_id=fa9e77d7514a49bca2dc21198dbbc66e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:07.070258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d46b12-4da4-4a88-bb02-9902ab20e5c3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:07.071824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 217/454] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 07:58:06 2022] GET /identity/v3/groups/fa9e77d7514a49bca2dc21198dbbc66e => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:07.078250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:07.116114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:07.182609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1636c-3878-43c6-bb4f-47b952b06434 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:07.214890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc308457-d4d7-4664-aab7-f3380ab202fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:07.215502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc308457-d4d7-4664-aab7-f3380ab202fe None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:07.215781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc308457-d4d7-4664-aab7-f3380ab202fe None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:07.216048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc308457-d4d7-4664-aab7-f3380ab202fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:07.217156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc308457-d4d7-4664-aab7-f3380ab202fe None admin] RBAC: Adding query filter params (group.id=fa9e77d7514a49bca2dc21198dbbc66e, role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=10bafec90d23450dbc1d1f64870e5868) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:07.217460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc308457-d4d7-4664-aab7-f3380ab202fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:07.218884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc308457-d4d7-4664-aab7-f3380ab202fe None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:07.224378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 238/455] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 07:58:07 2022] GET /identity/v3/role_assignments?group.id=fa9e77d7514a49bca2dc21198dbbc66e&scope.project.id=10bafec90d23450dbc1d1f64870e5868&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:09.765926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093a919-b71f-4e5d-bfe7-387b5567f960 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:09.766938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093a919-b71f-4e5d-bfe7-387b5567f960 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:09.767450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093a919-b71f-4e5d-bfe7-387b5567f960 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:09.769225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 218/456] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:09.774388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c2b5-36d4-483f-b637-fd44dc8f6c27 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:09.775183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c2b5-36d4-483f-b637-fd44dc8f6c27 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:09.775707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c2b5-36d4-483f-b637-fd44dc8f6c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:09.800254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c132c2b5-36d4-483f-b637-fd44dc8f6c27 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:09.801799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c132c2b5-36d4-483f-b637-fd44dc8f6c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:09.901940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 239/457] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:09.942945 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ff30-3f5d-4b0e-a23c-ba500fe1388c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:09.943610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ff30-3f5d-4b0e-a23c-ba500fe1388c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:09.944074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ff30-3f5d-4b0e-a23c-ba500fe1388c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:09.945584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 219/458] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:09.946756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132c2b5-36d4-483f-b637-fd44dc8f6c27 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:09.959332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99fea-eb6a-4385-871e-51c229735aa7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:09.959751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99fea-eb6a-4385-871e-51c229735aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:09.959916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99fea-eb6a-4385-871e-51c229735aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:09.987051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-eae99fea-eb6a-4385-871e-51c229735aa7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:09.989573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-eae99fea-eb6a-4385-871e-51c229735aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:10.002105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:10.112134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 220/459] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:10.115288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132c2b5-36d4-483f-b637-fd44dc8f6c27 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:10.133554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae99fea-eb6a-4385-871e-51c229735aa7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:10.150955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:10.151618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.151936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.152173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.163909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:10.165361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:10.180208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:10.181189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:10.182044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:10.182044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:10.182044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:10.182044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 240/460] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:10.190637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:10.235961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:10.304040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:10.321222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e051ee8-f0da-4832-8e62-4109b946835d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:10.336455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae99fea-eb6a-4385-871e-51c229735aa7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:10.367850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258404-4e68-4547-bf9f-a471a6f68091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:10.368784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258404-4e68-4547-bf9f-a471a6f68091 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.369068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258404-4e68-4547-bf9f-a471a6f68091 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.369344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258404-4e68-4547-bf9f-a471a6f68091 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.370239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea258404-4e68-4547-bf9f-a471a6f68091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:10.370568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea258404-4e68-4547-bf9f-a471a6f68091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:10.371968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea258404-4e68-4547-bf9f-a471a6f68091 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:10.376259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef0b20-b34a-4b4b-a2f5-605d8e3ae04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:10.377256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef0b20-b34a-4b4b-a2f5-605d8e3ae04b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.377805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef0b20-b34a-4b4b-a2f5-605d8e3ae04b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.378369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef0b20-b34a-4b4b-a2f5-605d8e3ae04b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.386109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 241/461] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:10.387502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d47cda-bd9b-46d7-a97d-03265a87957f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.387785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d47cda-bd9b-46d7-a97d-03265a87957f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.388104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d47cda-bd9b-46d7-a97d-03265a87957f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.391701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 242/462] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:10.392657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d47cda-bd9b-46d7-a97d-03265a87957f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:10.398981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef0b20-b34a-4b4b-a2f5-605d8e3ae04b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:10.400544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef0b20-b34a-4b4b-a2f5-605d8e3ae04b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-07ef0b20-b34a-4b4b-a2f5-605d8e3ae04b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:10.416949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:10.417902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:10.419630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:10.419630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:10.419630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:10.419630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 221/463] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:10.424174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163276-cb16-4a41-8f59-785d74470167 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.424459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163276-cb16-4a41-8f59-785d74470167 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.424723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163276-cb16-4a41-8f59-785d74470167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.442918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-58163276-cb16-4a41-8f59-785d74470167 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:10.444112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-58163276-cb16-4a41-8f59-785d74470167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:10.503136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d47cda-bd9b-46d7-a97d-03265a87957f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:10.512204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 222/464] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:10.513296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bfab-e719-4ec7-b707-0d7aa9e10327 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.513577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bfab-e719-4ec7-b707-0d7aa9e10327 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.513839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bfab-e719-4ec7-b707-0d7aa9e10327 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.519269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 223/465] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:10.519269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bfab-e719-4ec7-b707-0d7aa9e10327 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:10.548797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:10.554216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06591524-f326-4959-8569-1b7ec16e7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:10.554758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591524-f326-4959-8569-1b7ec16e7c2a None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.555033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591524-f326-4959-8569-1b7ec16e7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.555300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06591524-f326-4959-8569-1b7ec16e7c2a None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.555959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06591524-f326-4959-8569-1b7ec16e7c2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:10.557525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06591524-f326-4959-8569-1b7ec16e7c2a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:10.568943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:10.592343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 243/466] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:58:10 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:10.594774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c6a80-f3f1-4e21-a1c3-106d11d5b245 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.595150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c6a80-f3f1-4e21-a1c3-106d11d5b245 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.595478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c6a80-f3f1-4e21-a1c3-106d11d5b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.622051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4d3c6a80-f3f1-4e21-a1c3-106d11d5b245 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:10.624248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4d3c6a80-f3f1-4e21-a1c3-106d11d5b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:10.647337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bfab-e719-4ec7-b707-0d7aa9e10327 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:10.689809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:10.690730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.691249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.691909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.692760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:10.693240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:10.694918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:10.719442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 244/467] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:10.719442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c6a80-f3f1-4e21-a1c3-106d11d5b245 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:10.724661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 224/468] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:10.730023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:10.835044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c6a80-f3f1-4e21-a1c3-106d11d5b245 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:10.838288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:10.862074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0103a-b59d-4bd9-bd83-3f1f17da64c1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:10.872614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:10.881920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:10.882639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.882889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.883160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.896402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:10.898585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:10.903937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:10.904559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:10.904890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:10.905169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:10.905812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:10.907268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:10.916927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:10.917839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:10.918713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:10.918713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:10.918713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:10.922136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 245/469] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:10.923398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:10.937464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 225/470] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:58:10 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:10.938609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:11.059659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e216f-2032-4510-9b64-56a10021924d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:11.102532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:11.103645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.104300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.104806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.117985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:11.119868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:11.136775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:11.137741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:11.138665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:11.138665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:11.138665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:11.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 246/471] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:11.147341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:11.167305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb337e-4ba0-4d47-941b-1622f241d3fe None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:11.184444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:11.217324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:11.217974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.218255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.218528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.219189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:11.219545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:11.220948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:11.231498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:11.237416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 226/472] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:11.248624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:11.280365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268aedf-1b16-48ba-8b3f-e5ed8b7d6c19 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:11.321366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:11.321978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.322254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.322522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.323163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:11.323501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:11.324864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:11.343227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 247/473] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:11.352456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:11.382842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2c3fc-bdb5-4c65-8a39-7ff5b8a6bcb8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:11.427852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d68f4d-c47e-4cc9-87fc-42b44ba042de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:11.428745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68f4d-c47e-4cc9-87fc-42b44ba042de None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.429289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68f4d-c47e-4cc9-87fc-42b44ba042de None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.429568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68f4d-c47e-4cc9-87fc-42b44ba042de None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.430213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68f4d-c47e-4cc9-87fc-42b44ba042de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:11.431862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68f4d-c47e-4cc9-87fc-42b44ba042de None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:11.458768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 227/474] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:58:11 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:11.467363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:11.480777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c992a6-f3b1-4480-a7be-b92f5d679777 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:11.528477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16156ee-9ab0-4e24-b50e-ba21bbbc8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:11.529231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16156ee-9ab0-4e24-b50e-ba21bbbc8ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.529512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16156ee-9ab0-4e24-b50e-ba21bbbc8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.529786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16156ee-9ab0-4e24-b50e-ba21bbbc8ae3 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.530496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16156ee-9ab0-4e24-b50e-ba21bbbc8ae3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:11.531983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16156ee-9ab0-4e24-b50e-ba21bbbc8ae3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:11.562513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 248/475] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:58:11 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:11.661088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3cc0-35a8-4067-b2b3-32743f8c41f0 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.661424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3cc0-35a8-4067-b2b3-32743f8c41f0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.661634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3cc0-35a8-4067-b2b3-32743f8c41f0 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.663339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 228/476] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:11.669806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fb079-0428-448d-8376-08f8955721f2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.670189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fb079-0428-448d-8376-08f8955721f2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.670416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fb079-0428-448d-8376-08f8955721f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.690762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b33fb079-0428-448d-8376-08f8955721f2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:11.692108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b33fb079-0428-448d-8376-08f8955721f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:11.767652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 249/477] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:11.790735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3cc0-35a8-4067-b2b3-32743f8c41f0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:11.862955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:11.912936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3cc0-35a8-4067-b2b3-32743f8c41f0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:11.953582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:11.954671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:11.955168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:11.955668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:11.956529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:11.958117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:11.967961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.sql.core [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 07:58:11.967961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 07:58:11.967961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [parameters: {'id': '99c34089a782472f87faabb3bb1a75e6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 07:58:11.967961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80382) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application result.read() Aug 10 07:58:11.985810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:58:11.986839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application yield resource Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise self.value Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application session.commit() Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 07:58:11.987842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self.session.flush() Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application compat.raise_( Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 07:58:11.988732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:58:11.989618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application result.read() Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:58:11.992006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [parameters: {'id': '99c34089a782472f87faabb3bb1a75e6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:11.994001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 07:58:11.995853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:12.000040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 229/478] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 07:58:11 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:12.013951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fb079-0428-448d-8376-08f8955721f2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:12.111869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:12.141057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fb079-0428-448d-8376-08f8955721f2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:12.188519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ce78d-0eba-4afe-9408-031aff25fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:12.189310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ce78d-0eba-4afe-9408-031aff25fb5c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:12.189680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ce78d-0eba-4afe-9408-031aff25fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:12.190056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ce78d-0eba-4afe-9408-031aff25fb5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:12.203169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ce78d-0eba-4afe-9408-031aff25fb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-147ce78d-0eba-4afe-9408-031aff25fb5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:12.208010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:12.209031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 07:58:12.210041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:12.211966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 250/479] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:12.217933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:12.349989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20231c0a-6b8c-472f-9e23-2aaf0729a98c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:12.371756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:12.385144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54102f11-d5e9-42b3-bb88-33c1399685dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:12.386295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54102f11-d5e9-42b3-bb88-33c1399685dc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:12.386637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54102f11-d5e9-42b3-bb88-33c1399685dc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:12.387028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54102f11-d5e9-42b3-bb88-33c1399685dc None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:12.388633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54102f11-d5e9-42b3-bb88-33c1399685dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:12.389366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54102f11-d5e9-42b3-bb88-33c1399685dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:12.391583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54102f11-d5e9-42b3-bb88-33c1399685dc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:12.400991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 230/480] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:12.956440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096f94-aa67-4d77-86b2-7f5da0d45c39 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:12.956829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096f94-aa67-4d77-86b2-7f5da0d45c39 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:12.957010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096f94-aa67-4d77-86b2-7f5da0d45c39 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:12.958517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 251/481] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:12.964440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c401-bd39-428b-8f34-bfba79e52d3e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:12.965330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c401-bd39-428b-8f34-bfba79e52d3e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:12.965818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c401-bd39-428b-8f34-bfba79e52d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:12.986407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-42e2c401-bd39-428b-8f34-bfba79e52d3e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:12.987961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-42e2c401-bd39-428b-8f34-bfba79e52d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:13.067512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 231/482] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:13.084912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86096f94-aa67-4d77-86b2-7f5da0d45c39 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:13.205328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86096f94-aa67-4d77-86b2-7f5da0d45c39 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:13.257084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:13.257628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:13.257903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:13.258167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:13.261012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:13.273397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:13.278034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:13.279253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:13.280569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 252/483] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:13.287481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2c401-bd39-428b-8f34-bfba79e52d3e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:13.396018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2c401-bd39-428b-8f34-bfba79e52d3e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:13.418143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:13.451740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b715e7d-0096-46a9-976d-e959d9c7fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:13.452367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b715e7d-0096-46a9-976d-e959d9c7fc4a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:13.452639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b715e7d-0096-46a9-976d-e959d9c7fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:13.452901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b715e7d-0096-46a9-976d-e959d9c7fc4a None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:13.453561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b715e7d-0096-46a9-976d-e959d9c7fc4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:13.453855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b715e7d-0096-46a9-976d-e959d9c7fc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:13.455231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b715e7d-0096-46a9-976d-e959d9c7fc4a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:13.465044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 232/484] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:13.470452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:13.599834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b096c-9e34-4e0f-a605-845001726deb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:13.630043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b624a5-d70c-420f-a66e-7f94d45ef3f4 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:13.630345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b624a5-d70c-420f-a66e-7f94d45ef3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:13.630585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b624a5-d70c-420f-a66e-7f94d45ef3f4 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:13.632169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 233/485] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:13.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fc3c4-8663-47d4-9e93-f1edd1e807df None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:13.637060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fc3c4-8663-47d4-9e93-f1edd1e807df None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:13.637337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fc3c4-8663-47d4-9e93-f1edd1e807df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:13.659736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:13.660344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:13.660617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:13.660882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:13.674838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:13.676323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:13.677626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-377fc3c4-8663-47d4-9e93-f1edd1e807df None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:13.678807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-377fc3c4-8663-47d4-9e93-f1edd1e807df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:13.699776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:13.701318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:13.702422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:13.702422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:13.702422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:13.704638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 253/486] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:13.711043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:13.805777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 234/487] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:13.811775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:13.840987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fc3c4-8663-47d4-9e93-f1edd1e807df None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:13.872773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84655b-7ddc-4b1e-9b2b-a5c8f22ca367 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:13.944645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:13.945652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:13.945936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:13.946213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:13.946874 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:13.947178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:13.948804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:13.958400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fc3c4-8663-47d4-9e93-f1edd1e807df None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:13.967521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:13.976225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 254/488] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:13.981979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.032087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.032728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.033689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.033960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.054589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:14.062772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:14.063728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:14.064525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 235/489] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:14.071770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.123224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e03bb-45de-4091-8656-86c46a740092 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.134310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:14.164530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbdd1e-ba91-4945-9af7-5876a240e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.165676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbdd1e-ba91-4945-9af7-5876a240e5cd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.165953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbdd1e-ba91-4945-9af7-5876a240e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.166219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbdd1e-ba91-4945-9af7-5876a240e5cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.175862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbdd1e-ba91-4945-9af7-5876a240e5cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:14.177872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbdd1e-ba91-4945-9af7-5876a240e5cd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e9bbdd1e-ba91-4945-9af7-5876a240e5cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:14.195485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:14.196419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:14.197324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:14.199933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 255/490] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:58:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:14.200979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc390c-b397-4711-87d1-fcfb2fc64791 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.201254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc390c-b397-4711-87d1-fcfb2fc64791 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.201517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc390c-b397-4711-87d1-fcfb2fc64791 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.204222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 256/491] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:14.204910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc390c-b397-4711-87d1-fcfb2fc64791 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.241317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3720f7a-a489-4f1e-a5cb-6f96a5bf250a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.283640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08a37e-89a1-43cc-999c-c8aacdd3d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.284356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a37e-89a1-43cc-999c-c8aacdd3d57c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.284637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a37e-89a1-43cc-999c-c8aacdd3d57c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.284904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a37e-89a1-43cc-999c-c8aacdd3d57c None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.285570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08a37e-89a1-43cc-999c-c8aacdd3d57c None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:14.285871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08a37e-89a1-43cc-999c-c8aacdd3d57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:14.287487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08a37e-89a1-43cc-999c-c8aacdd3d57c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:14.305399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 236/492] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:14.311576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a6d23-67d1-4336-9abd-342a329c506f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.311978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a6d23-67d1-4336-9abd-342a329c506f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.312239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a6d23-67d1-4336-9abd-342a329c506f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.334339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2d7a6d23-67d1-4336-9abd-342a329c506f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:14.335437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2d7a6d23-67d1-4336-9abd-342a329c506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:14.352818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc390c-b397-4711-87d1-fcfb2fc64791 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.360193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:14.406404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.406930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.407207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.407526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.408271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:14.408575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:14.410012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:14.418427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 237/493] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:14.420131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a6d23-67d1-4336-9abd-342a329c506f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.475955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 257/494] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:14.476740 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.506854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:14.529628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a6d23-67d1-4336-9abd-342a329c506f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.563162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.563823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.564102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.564374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.577815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:14.579277 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:14.585296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665480-7ddf-47e1-aac1-40fb0f7f96ce None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:14.595019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:14.596137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:14.597001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:14.597001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:14.597001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:14.600849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 238/495] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:14.600849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.613890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:14.625320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74d7ee-8c20-4ea6-be79-12e3d216f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.625939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74d7ee-8c20-4ea6-be79-12e3d216f87d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.626209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74d7ee-8c20-4ea6-be79-12e3d216f87d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.626474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74d7ee-8c20-4ea6-be79-12e3d216f87d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.636537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74d7ee-8c20-4ea6-be79-12e3d216f87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3d74d7ee-8c20-4ea6-be79-12e3d216f87d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:14.641675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:14.642583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:14.643385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 258/496] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:14.650254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba17bc-b658-44d9-9938-42ac3d19a891 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.650254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba17bc-b658-44d9-9938-42ac3d19a891 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.650254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba17bc-b658-44d9-9938-42ac3d19a891 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.650254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 259/497] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:14.650492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba17bc-b658-44d9-9938-42ac3d19a891 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.722943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d27a2-b90b-4fef-8e7f-56eec1c5025e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.743804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:14.761101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba17bc-b658-44d9-9938-42ac3d19a891 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.763875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94329140-3d81-421e-be49-39438e783fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.764859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94329140-3d81-421e-be49-39438e783fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.764859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94329140-3d81-421e-be49-39438e783fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.765028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94329140-3d81-421e-be49-39438e783fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.798442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.799340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.799816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.800091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.800741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:14.801041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:14.802426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:14.814865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 260/498] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:14.816043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.838792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94329140-3d81-421e-be49-39438e783fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:14.840536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94329140-3d81-421e-be49-39438e783fb0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:14.851172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:14.927685 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec8e4-17cd-4f31-9608-695be485aad4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:14.949116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 239/499] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:14.954832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5719b2-73e9-4bfb-8744-6b36fd1c9c21 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.955121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5719b2-73e9-4bfb-8744-6b36fd1c9c21 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.955401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5719b2-73e9-4bfb-8744-6b36fd1c9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.967311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:14.968592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:14.969014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:14.969573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:14.970474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:14.970925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:14.972495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:14.973572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1c5719b2-73e9-4bfb-8744-6b36fd1c9c21 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:14.974708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1c5719b2-73e9-4bfb-8744-6b36fd1c9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:14.982655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 261/500] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:14.983285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:14.994504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.067552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 240/501] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:15.068756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5719b2-73e9-4bfb-8744-6b36fd1c9c21 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.098487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadce842-3117-4e43-943b-5c395cb709c8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.111333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.139282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.140321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.140321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.140489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.148127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.149568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:15.161053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:15.161975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:15.162862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 262/502] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:15.163484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.180971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5719b2-73e9-4bfb-8744-6b36fd1c9c21 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.216758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.217378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.217648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.217912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.228208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.229596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.233815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:15.247856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:15.249136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:15.250082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:15.250082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:15.250082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:15.250082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 241/503] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:15.252546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.271172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff9fd5-29e3-4539-bbcd-6d6b48799fdd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.305678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.306303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.306577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.306843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.317714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.319150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:15.333360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:15.334297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:15.335153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:15.335153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:15.335153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:15.335153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 263/504] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:15.335368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.354209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.363806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd99ecb-f486-44b3-bfec-1fd2823f5e69 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.396558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.397198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.397470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.397736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.408093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:15.413139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:15.414045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:15.414879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 242/505] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:15.415721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.442188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9f957-10b9-4dd0-860e-684804ee9fe5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.461476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.475827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b7258-e663-4d3c-a9ee-40bb6cf43816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.476522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b7258-e663-4d3c-a9ee-40bb6cf43816 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.476804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b7258-e663-4d3c-a9ee-40bb6cf43816 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.477094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b7258-e663-4d3c-a9ee-40bb6cf43816 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.477801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b7258-e663-4d3c-a9ee-40bb6cf43816 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:15.478104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b7258-e663-4d3c-a9ee-40bb6cf43816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.479609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b7258-e663-4d3c-a9ee-40bb6cf43816 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.496538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 264/506] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:15.498359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08f50-1fed-4f89-a2aa-83c0dc1a848b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.498643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08f50-1fed-4f89-a2aa-83c0dc1a848b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.499004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08f50-1fed-4f89-a2aa-83c0dc1a848b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.500299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 265/507] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:15.504269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea08f50-1fed-4f89-a2aa-83c0dc1a848b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.513581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213ba4-fa07-4800-88d1-60f658d3954e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.547214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.547839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.548119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.548392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.549029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:15.549326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.550696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.562625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 243/508] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:15.563641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.575049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.604431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea08f50-1fed-4f89-a2aa-83c0dc1a848b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.639732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.640342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.640623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.640894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.641535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:15.641838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.643197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.655434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 266/509] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:15.656260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.664209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1292eec-ca2e-45a2-a654-4b9d9b193168 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.698799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.699766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f232c-1a6f-407f-a545-950202c0d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.700394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f232c-1a6f-407f-a545-950202c0d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.700674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f232c-1a6f-407f-a545-950202c0d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.701007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f232c-1a6f-407f-a545-950202c0d6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.701635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f232c-1a6f-407f-a545-950202c0d6a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:15.701936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f232c-1a6f-407f-a545-950202c0d6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.703315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f232c-1a6f-407f-a545-950202c0d6a3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.711021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 244/510] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:15.712178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233058a9-9584-450e-8991-1ef4dcfc59f8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.712475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233058a9-9584-450e-8991-1ef4dcfc59f8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.712801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233058a9-9584-450e-8991-1ef4dcfc59f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.730352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-233058a9-9584-450e-8991-1ef4dcfc59f8 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:15.731556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-233058a9-9584-450e-8991-1ef4dcfc59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:15.759796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeabf4c-e02a-4541-8929-e25707c44055 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.792689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.793295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.793577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.793852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.798006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 245/511] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:15.798822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233058a9-9584-450e-8991-1ef4dcfc59f8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.812283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.862265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.863745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.897735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233058a9-9584-450e-8991-1ef4dcfc59f8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:15.900425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:15.930526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:15.931150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:15.931447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:15.931726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:15.939159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:15.940638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:15.952770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:15.953808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 246/512] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:15.954829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:15.966242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 267/513] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:15.967075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.017410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.056213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab237-9794-498d-bf16-4a444386f478 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.070902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d5e57-3418-4ea0-af6e-076ddd5644fb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.089717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.090337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.090610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.090908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.098651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.100135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.104834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.105448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.105729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.106000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:16.113123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:16.114248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:58:16.115671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:16.116304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.118816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 247/514] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:16.119632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.120754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.122785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:16.137523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:16.138483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:16.139329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:16.139329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:16.139329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:16.139329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 268/515] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:16.140017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.217032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5857fe-3e9e-4c59-90ee-b52391b9b9a1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.238958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b776a5-0a7f-4e66-9301-42772b4f19a1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.239204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.251754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.252394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.252676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.252947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.263297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.264839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.272708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.273241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.273516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.273788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.274501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:16.274817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.276224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:16.278892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:16.279989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:16.280992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:16.280992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:16.280992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:16.283685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 248/516] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:16.284490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.295654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 269/517] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:16.296512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.353038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.390504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08264a2-b724-400a-a8d8-a3c713d92303 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.402630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9452-8aea-4e43-b6d5-408882851ee4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.423054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.423707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.423990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.424266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.436363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.436549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.436965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.437236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.437501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.437861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.438228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:16.438523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.439967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:16.452595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:16.453695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:16.454711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:16.454711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:16.454711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:16.454711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 249/518] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:16.454962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.458598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 270/519] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:16.460297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.485193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.556118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c310-5001-4a46-8e2b-2b3d14212501 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.556384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251d13f-f828-4e30-b570-3b73f00130dd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.566038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.590458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.591120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.591357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.591522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.591683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.592146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.592311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:16.592536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.592627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.592910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.593610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:16.593976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.594075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.595441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.605318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 250/520] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:16.606096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.606842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 271/521] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:16.607426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.689902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.704904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a697b7-ea62-48c5-b5c7-3f7b63f1d629 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.705044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e702c-6ea7-4870-bf71-760c8e37042e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.738553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.738991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.739145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.739440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.739617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.739705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.739898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.740173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.740407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=b4e95079af6b4768bc38709a8bdc27bf) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:16.740709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.740794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:16.741096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.742125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.742451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.748371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 251/522] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/role_assignments?user.id=b4e95079af6b4768bc38709a8bdc27bf&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:16.749183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.754469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 272/523] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:16.755314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.790060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.866214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb3714-fd76-4d74-995d-e2d51181f1fc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.877385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9644-9202-4f1b-bc73-b3b2a1c92b16 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:16.906126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.906908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.907293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.918332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:16.918985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:16.919291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:16.919604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:16.920249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.921680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:16.926388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:16.951444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 273/524] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:58:16 2022] POST /identity/v3/users => generated 247 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:16.951444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:16.994156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:16.995923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.052844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:17.074890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac66fc1-57ec-4707-b93e-c7b142eb3cef None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.112898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.113535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.113855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.114125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.123080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.124543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:17.137922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:17.139099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 274/525] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:17.145471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.153154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 252/526] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:17.155139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.228527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:17.265502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870399d-8cfd-4860-9b7e-4dca18a2f728 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.300210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d891786-2f21-44df-bcb0-2bfc94829259 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.313537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.314443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.314795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.315143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.324577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.327728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:17.342509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:17.343449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:17.344322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 275/527] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:17.344959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.347758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.348843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.350363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:17.350557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.351734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.352679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:17.353126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.354766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.406823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 253/528] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:17.407917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.467389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818236-00cd-4f54-a233-8861b11233eb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.507921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.508721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.509104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.509474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.522635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.524308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:17.544244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:17.545415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:17.546484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:17.546484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:17.546484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:17.546761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a17bd4-fffc-4e5a-9eae-a53df169a7ff None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.548375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 276/529] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:17.549523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.562265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:17.596719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.598444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.599095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.599541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.600639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:17.601048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.603283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.627281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:17.634202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 254/530] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:17.634202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.679832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b0a0a-7cc7-4b05-86c8-cf69019ab6d1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.737622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.738243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.738524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.738799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.754268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133335d0-90cd-4c1d-b308-c3d95fc989e9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.793303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.794606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.795177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.795711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.796570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:17.797087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.798922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.812379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 255/531] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:17.813723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.825906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.828628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.846551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:17.911814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:17.926882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b042780-1ee8-4f46-942d-7ed4833ac6a5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:17.965178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:17.965731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:17.966133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:17.966715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:17.967502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=de7826aa1f8e4076ad5656f8cf7fe2e7) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:17.967812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:17.969269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:17.971498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 277/532] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:17.973057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:17.975614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 256/533] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/role_assignments?user.id=de7826aa1f8e4076ad5656f8cf7fe2e7&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:17.976947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:18.109361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0ba12-2994-4734-ab2e-971d2b93876e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:18.110142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:18.123847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0880e-3560-4409-b91f-ed38ec31e2e4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:18.148021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:18.148698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.148943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.149215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.157837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:18.159336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:18.164473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:18.165078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.165359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.165630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:18.172527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:18.173443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:18.175399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 278/534] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:18.179201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:18.179789 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:18.181316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:18.197300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:18.199523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:18.201645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:18.201645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:18.201645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:18.207437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 257/535] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:18.207437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:18.241377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:18.333153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119243fa-5f2b-469f-a5db-c197aa3c0448 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:18.386391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c1d10-811b-4156-afb5-c5bf9987e804 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:18.406050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:18.407035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.407549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.408025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.408905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:18.409444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:18.411341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:18.435957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 258/536] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:18.441620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:18.448506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:18.465500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:18.467113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.467626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.468091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.469010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:18.470706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:18.472397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:18.495752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 279/537] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:18.501755 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:18.622762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:18.651553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908a58c-c050-4641-94b4-58621968da25 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:18.668186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92fa4-ab55-4576-9e76-ad051abb6578 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:18.714672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:18.714672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.714672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.714672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.726003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:18.727465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:18.732485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:18.733115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.733401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.733679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.734426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=465160a7e1c24601b83be37681ef322d) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:18.734739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:18.736281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:18.739207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:18.740069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:18.740920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 259/538] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:18.746113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 280/539] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:18 2022] GET /identity/v3/role_assignments?user.id=465160a7e1c24601b83be37681ef322d&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:18.752573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:18.839099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:18.884628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75708bf-9173-4c84-a042-d1a34af77d8b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:18.923535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a7629-4f6a-4361-b642-8ecd1290cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:18.924254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7629-4f6a-4361-b642-8ecd1290cb49 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.924527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7629-4f6a-4361-b642-8ecd1290cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.924792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7629-4f6a-4361-b642-8ecd1290cb49 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.925488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a7629-4f6a-4361-b642-8ecd1290cb49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:18.925785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a7629-4f6a-4361-b642-8ecd1290cb49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:18.927241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a7629-4f6a-4361-b642-8ecd1290cb49 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:18.942222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 260/540] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:18.948134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:18.976469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5743fa-3090-43fb-ac8c-e7f1fcb976d2 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.976799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5743fa-3090-43fb-ac8c-e7f1fcb976d2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.977004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5743fa-3090-43fb-ac8c-e7f1fcb976d2 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:18.978328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 261/541] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:18.984185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606916-12e2-4918-8cee-4b410f4eb4a7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:18.984460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606916-12e2-4918-8cee-4b410f4eb4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:18.984743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606916-12e2-4918-8cee-4b410f4eb4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.005053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3a606916-12e2-4918-8cee-4b410f4eb4a7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:19.005739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3a606916-12e2-4918-8cee-4b410f4eb4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:19.081643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df814-0644-49e8-be8a-68637c488b09 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:19.091437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 262/542] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:19.137314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:19.139293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.139814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.140306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.141284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=a3812df0dc174249acb139876f4302ab) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:19.141794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:19.143538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:19.155890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 281/543] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:18 2022] GET /identity/v3/role_assignments?user.id=a3812df0dc174249acb139876f4302ab&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:19.162920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606916-12e2-4918-8cee-4b410f4eb4a7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:19.239683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:19.290706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606916-12e2-4918-8cee-4b410f4eb4a7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:19.328994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:19.329708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.329987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.330252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.342274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:19.347007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:19.349148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:19.351116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 263/544] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:19.355447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:19.368338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:19.492242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89f5f-8c22-4b09-97a3-03a11cd9177d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:19.538827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04c900-d7ab-459e-bfb3-4278fb3fb6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:19.539831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04c900-d7ab-459e-bfb3-4278fb3fb6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.540336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04c900-d7ab-459e-bfb3-4278fb3fb6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.540870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04c900-d7ab-459e-bfb3-4278fb3fb6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.541738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04c900-d7ab-459e-bfb3-4278fb3fb6a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:19.542235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04c900-d7ab-459e-bfb3-4278fb3fb6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:19.543912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04c900-d7ab-459e-bfb3-4278fb3fb6a1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:19.552866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 282/545] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:19.560928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:19.638043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa722a5-691b-4d94-aabc-f41ae416ecb2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.638674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa722a5-691b-4d94-aabc-f41ae416ecb2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.639150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa722a5-691b-4d94-aabc-f41ae416ecb2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.640981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 283/546] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:19.645904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1160b-c41c-4001-9149-bfaecac97827 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.646401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1160b-c41c-4001-9149-bfaecac97827 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.646873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1160b-c41c-4001-9149-bfaecac97827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.680377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-61f1160b-c41c-4001-9149-bfaecac97827 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:19.681941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-61f1160b-c41c-4001-9149-bfaecac97827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:19.688816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49cd6-1320-442c-a1fa-4b1e240d2d88 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:19.703102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:19.727065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:19.728026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:19.728670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:19.729316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:19.742497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:19.744561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:19.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:19.761249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:19.762094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:19.762094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:19.762094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:19.764989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 264/547] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:19.771680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:19.851874 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:19.856278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 284/548] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:19.900847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1160b-c41c-4001-9149-bfaecac97827 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:19.920481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b2c6a-019f-4234-bcc9-5e4213083244 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.020133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.020752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.021025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.021293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.021941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:20.022238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.023639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.038183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1160b-c41c-4001-9149-bfaecac97827 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.046227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 265/549] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:20.082247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.117630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.118775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.119057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.119328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.123874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.144333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:20.149379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:20.150760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:20.151768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:20.157477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 285/550] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:20.160848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.254436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.254765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2094cf-fb7e-4c3c-8b94-eca4db06cf45 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.313353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e133-b5aa-4618-8e04-4a34f640c4a0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.329191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.330034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.330455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.330865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.344655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.347599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:20.364556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:20.365743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:20.366901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:20.369161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 266/551] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:20.374451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.395016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81bbf-6c41-4a66-bbeb-f7f525406519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.395747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81bbf-6c41-4a66-bbeb-f7f525406519 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.396192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81bbf-6c41-4a66-bbeb-f7f525406519 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.396549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81bbf-6c41-4a66-bbeb-f7f525406519 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.397241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf81bbf-6c41-4a66-bbeb-f7f525406519 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:20.397637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf81bbf-6c41-4a66-bbeb-f7f525406519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.399121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf81bbf-6c41-4a66-bbeb-f7f525406519 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.408764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 286/552] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:20.409952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fcc74-5c42-40d2-b602-0d6a5338f9dd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.410327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fcc74-5c42-40d2-b602-0d6a5338f9dd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.410680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fcc74-5c42-40d2-b602-0d6a5338f9dd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.412290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 287/553] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:20.416501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fcc74-5c42-40d2-b602-0d6a5338f9dd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.502357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648882-6d50-42bf-8b22-a2e16d8d5f39 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.515775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.542578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fcc74-5c42-40d2-b602-0d6a5338f9dd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.542874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8f52-314a-4b4a-8145-a6fda6ecc106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.544184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8f52-314a-4b4a-8145-a6fda6ecc106 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.544807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8f52-314a-4b4a-8145-a6fda6ecc106 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.545177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8f52-314a-4b4a-8145-a6fda6ecc106 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.546959 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8f52-314a-4b4a-8145-a6fda6ecc106 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:20.547337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8f52-314a-4b4a-8145-a6fda6ecc106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.548883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8f52-314a-4b4a-8145-a6fda6ecc106 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.567515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.583541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 267/554] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:20.584896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756c2e-80df-440a-9bdc-376d0463101a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.585175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756c2e-80df-440a-9bdc-376d0463101a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.585445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756c2e-80df-440a-9bdc-376d0463101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.598897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.599779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.600302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.600713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.603941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ea756c2e-80df-440a-9bdc-376d0463101a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:20.605016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ea756c2e-80df-440a-9bdc-376d0463101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:20.613032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.614827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:20.632587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:20.633511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:20.634389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:20.634389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:20.634389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:20.636483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 288/555] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:20.637796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.683472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 268/556] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:20.683472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea756c2e-80df-440a-9bdc-376d0463101a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.754164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.781912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea756c2e-80df-440a-9bdc-376d0463101a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.783665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1779-b2c4-4a87-bb88-62cf9622f98f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:20.823141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.823890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.824214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.824486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.825696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:20.826049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.827437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.831117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:20.831983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:20.832537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:20.832989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:20.844715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 269/557] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:20.844715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.852865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:20.855291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:20.877072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:20.878486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:20.879450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:20.879450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:20.879450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:20.885800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 289/558] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:20.885800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:20.919537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:20.964465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a798b6-667d-45b9-a140-b27f04dca2e1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.001400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.002066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.002344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.002618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.005180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.017346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:21.023084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b98fb-f8b6-4cc6-b80f-7717a556d57a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:21.023774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:21.024712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 270/559] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:21.026262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.065972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.067023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.067664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.068144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.077303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.079167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:21.092403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:21.094185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:21.095783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:21.105647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 290/560] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:21.107111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.152068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293552f-f589-483b-ad17-dfde3c1eefcd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.190757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.191362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.191681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.191951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.192585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:21.192879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.194288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.206844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 271/561] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:21.207700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.214367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.234882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cc4a8-0ba7-4fa7-86dd-ff1dcca9bd2f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.268741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.274538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f483a-2403-4a2d-8201-c469b344e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.275495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f483a-2403-4a2d-8201-c469b344e3fd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.275926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f483a-2403-4a2d-8201-c469b344e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.276203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f483a-2403-4a2d-8201-c469b344e3fd None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.276880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f483a-2403-4a2d-8201-c469b344e3fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:21.277187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f483a-2403-4a2d-8201-c469b344e3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.278917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f483a-2403-4a2d-8201-c469b344e3fd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.287565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 291/562] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:21.288765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a906194-2f2c-4126-a9f9-7dd5bc85625e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.289055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a906194-2f2c-4126-a9f9-7dd5bc85625e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.289330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a906194-2f2c-4126-a9f9-7dd5bc85625e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.290632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 292/563] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:21.291270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a906194-2f2c-4126-a9f9-7dd5bc85625e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.330305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e5f1d-5ef9-49fd-b826-9b2671d787be None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.367016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.367649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.367924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.368192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.368903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:21.369202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.370617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.393255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 272/564] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:21.393255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.419490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a906194-2f2c-4126-a9f9-7dd5bc85625e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.457021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c72c99-ebf7-49a0-b682-7a7685ffc598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.457763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c72c99-ebf7-49a0-b682-7a7685ffc598 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.458098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c72c99-ebf7-49a0-b682-7a7685ffc598 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.458435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c72c99-ebf7-49a0-b682-7a7685ffc598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.465275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c72c99-ebf7-49a0-b682-7a7685ffc598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.466764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c72c99-ebf7-49a0-b682-7a7685ffc598 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-40c72c99-ebf7-49a0-b682-7a7685ffc598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:21.477850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:21.478785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 293/565] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:21.480287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397839b-6aa5-4232-8b58-3f80812c0550 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.480840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397839b-6aa5-4232-8b58-3f80812c0550 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.480840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397839b-6aa5-4232-8b58-3f80812c0550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.488861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.500883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a397839b-6aa5-4232-8b58-3f80812c0550 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:21.502056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a397839b-6aa5-4232-8b58-3f80812c0550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:21.503154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a1449-bbba-470c-839e-799d94dd95b6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.517051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.539388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.540037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.540320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.540592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.551822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.553269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:21.568732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:21.569692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:21.570648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:21.570648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:21.570648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:21.570648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 273/566] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:21.570648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.575453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 294/567] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:21.575453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397839b-6aa5-4232-8b58-3f80812c0550 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.675790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397839b-6aa5-4232-8b58-3f80812c0550 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.677190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a98528-55fd-490a-8517-c962bb51ee0a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.709242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7278bd-a369-43f4-b76e-4d9981c2bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.709727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.709878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7278bd-a369-43f4-b76e-4d9981c2bf5f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.710114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7278bd-a369-43f4-b76e-4d9981c2bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.710329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.710423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7278bd-a369-43f4-b76e-4d9981c2bf5f None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.710610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.710883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.711059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7278bd-a369-43f4-b76e-4d9981c2bf5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:21.711365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7278bd-a369-43f4-b76e-4d9981c2bf5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.712838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7278bd-a369-43f4-b76e-4d9981c2bf5f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.714388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.725434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 295/568] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:21.726619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4240f4-184e-4033-aa6b-872ceeff858c None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.726905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4240f4-184e-4033-aa6b-872ceeff858c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.727180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4240f4-184e-4033-aa6b-872ceeff858c None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.728561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 296/569] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:21.729534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4240f4-184e-4033-aa6b-872ceeff858c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.745295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.783273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.784766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.832738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4240f4-184e-4033-aa6b-872ceeff858c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.866422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:21.867011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:21.867282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:21.867583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:21.868206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:21.868504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:21.869863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:21.881556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 297/570] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:21.882350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.888814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 274/571] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:21.888814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:21.939460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.946793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:21.983661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab877-1896-48b2-a7d5-dcde1b627d45 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:21.985016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0517c2-d1af-4a1b-8f13-eb1f08a8188f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.018469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.018671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147837-3931-47e9-a7b3-af112d436764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.019095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147837-3931-47e9-a7b3-af112d436764 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.019191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.019377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147837-3931-47e9-a7b3-af112d436764 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.019498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.019677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/b4e95079af6b4768bc38709a8bdc27bf/roles/13b0eb7c0ad04dba9ae829944539f1f6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.019777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147837-3931-47e9-a7b3-af112d436764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.030002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147837-3931-47e9-a7b3-af112d436764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:22.033713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=b4e95079af6b4768bc38709a8bdc27bf, role_id=13b0eb7c0ad04dba9ae829944539f1f6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d2147837-3931-47e9-a7b3-af112d436764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:22.035007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:22.036090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:22.037354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:22.038147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.038232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 298/572] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:22.038232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467474-e7d9-4c78-a412-217ad10159e4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.038232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467474-e7d9-4c78-a412-217ad10159e4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.038232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467474-e7d9-4c78-a412-217ad10159e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.049526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 275/573] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:21 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/b4e95079af6b4768bc38709a8bdc27bf/roles/13b0eb7c0ad04dba9ae829944539f1f6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:22.050418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.057644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ae467474-e7d9-4c78-a412-217ad10159e4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:22.059124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ae467474-e7d9-4c78-a412-217ad10159e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:22.148869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 299/574] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:22.159721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467474-e7d9-4c78-a412-217ad10159e4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.184160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b80f-9dff-473a-912c-9baa77839980 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.202884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.206135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.226327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.226966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.227245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.227572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.235442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.236909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:22.249101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:22.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:22.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 276/575] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:22.252235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.267447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467474-e7d9-4c78-a412-217ad10159e4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.311131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.311800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.312075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.312347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.323149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.324756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:22.342102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:22.343092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:22.344046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:22.344046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:22.344046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:22.344046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 300/576] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:22.344046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.361109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f36b8-f7fd-40bf-8255-e6047dce5a6c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.397455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.398068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.398345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.398620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.399284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:22.399684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.401058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.414300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 277/577] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:22.414300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.452684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.453056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.459810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d198b-3cdd-49fc-a38b-7bea6ec4072d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.495095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.495776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.496055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.496326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.508140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:22.513544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:22.514456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:22.515327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 301/578] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:22.516069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.534023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171d1e-5eb5-488a-814e-5f77844d6b0a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.569758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.570354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.570631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.570901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.571652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:22.571951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.573371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.590144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 278/579] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:22.592432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.627228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557d3bc-f801-43c7-9f10-66296b1c1557 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.663743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.664343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.664616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.664882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.665514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:22.665814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.667167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.679341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 302/580] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:22.685286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.696655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.704146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74685d4-ef3c-4929-9cab-f109cf299bce None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.704274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.740557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.741191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.741478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.741749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.753162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.754624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:22.771251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:22.772351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:22.773500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:22.773500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:22.773500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:22.776987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 279/581] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:22.777632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.799825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89b48e-ab47-43c2-b57b-769856b38d10 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.835914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.836512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.836791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.837059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.837713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:22.838008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.839349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.852633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 303/582] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:22.852633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.887026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136122e-364f-4f31-b72f-bb08ff2e91d6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.924500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:22.925494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:22.925494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:22.925669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:22.935017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.937649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:22.939710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:22.946663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:22.955302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:22.956272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:22.957182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:22.957182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:22.957182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:22.964473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 280/583] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:22.964473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:22.964670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43124925-4e01-4933-b469-79ddf45336f7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:22.999639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.000544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.000828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.001102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.009697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.011771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:23.023709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:23.024633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:23.025538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 304/584] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:23.026031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.077520 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca371-14a4-40f6-8e54-bac1a1802168 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.113576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.114539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.114820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.115092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.116071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:23.116525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.117906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.132933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 281/585] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:23.133734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.140113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a588f6a-809d-4e6d-a801-96fc4420c9a5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.177244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.178456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.178733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.179001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.188094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:23.192484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.193933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.198773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:23.209692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:23.210667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:23.212182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:23.212182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:23.212182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:23.212182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 305/586] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:23.212182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.251629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b95e81-d316-4c56-a371-1358eeffcd26 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.294722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.295717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.296062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.296402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.297111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:23.297499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.298946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.313803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 282/587] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:23.314819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.327912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6ca1a-4eef-4b66-96e7-88683eaeb4dc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.364448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.365046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.365440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.365712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.366397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:23.366698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.368154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.386843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 306/588] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:23.386843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.430262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64a116-57d8-49aa-94db-a4361cae4631 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.437661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:23.450694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:23.470284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.470844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.471121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.471389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.479430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.480918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.492197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766e627-2c08-4da2-a750-d9516e2354fb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:23.492373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:23.493300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:58:23.494365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:23.498580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 283/589] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:23.499434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.531022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.531655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.531940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.532213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.532886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:23.533183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.534712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.548181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 307/590] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:23.549038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.612428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d6d2-72f2-4dfd-b574-d6a377862109 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.650672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.651279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.651586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.651857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.652579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca309e5-09fe-413e-b44d-094b95da1842 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.658693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.660181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.663693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:23.672688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:23.673591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:23.674484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 284/591] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:23.679325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.690358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.691011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.691296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.691598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.692325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=666116325de04177accd2bfece858554) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:23.692691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.694111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.700603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 308/592] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/role_assignments?user.id=666116325de04177accd2bfece858554&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:23.701450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.738433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:23.830657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b357f34-9bff-4fb9-a50c-76cd6d91c100 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.836705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6f794-cffb-4314-a01e-55539c3443d7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:23.869663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.871073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.871363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.871785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.880975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.882416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.882759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:23.883365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:23.883676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:23.883948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:23.884672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:23.884969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:23.886383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:23.894955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:23.896232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:58:23.897419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:23.899663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 309/593] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:23.900485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.910139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 285/594] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:23.911323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:23.943018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.017883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535a7e-1183-4a46-90ac-00ea47ca9dde None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.027631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.036142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08653bc8-abcb-4d11-b31d-767a17f4321b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.062875 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.063864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.064386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.064853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.065918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:24.066514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.068154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.077884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6563b-4d89-44b3-84fb-50eb4f2e030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.078842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6563b-4d89-44b3-84fb-50eb4f2e030b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.078842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6563b-4d89-44b3-84fb-50eb4f2e030b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.079151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6563b-4d89-44b3-84fb-50eb4f2e030b None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.079967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6563b-4d89-44b3-84fb-50eb4f2e030b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:24.080302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6563b-4d89-44b3-84fb-50eb4f2e030b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.082028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6563b-4d89-44b3-84fb-50eb4f2e030b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.083572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 310/595] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:24.084576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.100362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 286/596] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 07:58:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:24.101606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8b90-8232-44ed-a5d8-3bd4cd877c8e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.101891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8b90-8232-44ed-a5d8-3bd4cd877c8e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.102163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8b90-8232-44ed-a5d8-3bd4cd877c8e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.103512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 287/597] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:24.104072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8b90-8232-44ed-a5d8-3bd4cd877c8e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.188229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.195554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99b2e-4f6d-4d79-859a-ff75c0c607d7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.215777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8b90-8232-44ed-a5d8-3bd4cd877c8e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.234470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.235309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.235749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.236189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.246564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.248743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.252445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239f49b-95e3-4219-aab7-baa7984416f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.253104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239f49b-95e3-4219-aab7-baa7984416f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.253384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239f49b-95e3-4219-aab7-baa7984416f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.253655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239f49b-95e3-4219-aab7-baa7984416f6 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/de7826aa1f8e4076ad5656f8cf7fe2e7/roles/13b0eb7c0ad04dba9ae829944539f1f6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:24.264268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:24.265237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:24.266136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:24.266136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:24.266136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:24.266136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 311/598] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:24.266136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.273762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239f49b-95e3-4219-aab7-baa7984416f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=de7826aa1f8e4076ad5656f8cf7fe2e7, role_id=13b0eb7c0ad04dba9ae829944539f1f6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.275242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239f49b-95e3-4219-aab7-baa7984416f6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.295260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 288/599] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:24 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/de7826aa1f8e4076ad5656f8cf7fe2e7/roles/13b0eb7c0ad04dba9ae829944539f1f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:24.295260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15279-bed9-4a11-9ba3-2a62db88a1cc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.295260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15279-bed9-4a11-9ba3-2a62db88a1cc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.295260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15279-bed9-4a11-9ba3-2a62db88a1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.309385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.327857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a3c15279-bed9-4a11-9ba3-2a62db88a1cc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:24.329119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a3c15279-bed9-4a11-9ba3-2a62db88a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:24.400567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ddbf5-bdd5-4b66-a1aa-66a28450a486 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.426588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 289/600] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:24.427783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15279-bed9-4a11-9ba3-2a62db88a1cc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.442036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.443911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.444876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.445385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.468123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.469984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.477801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:24.488676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:24.489688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:24.490598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:24.490598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:24.490598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:24.492850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 312/601] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:24.493871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.554003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15279-bed9-4a11-9ba3-2a62db88a1cc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.601012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.601355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17890dbb-d879-4e6a-ac2f-76636e5ec603 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.601650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.601929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.602201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.602850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:24.603151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.605909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.607773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.624037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 290/602] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:24.628103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.645591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.646508 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.646942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.647349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.658318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:24.663774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:24.664867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:24.665877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:24.667997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 313/603] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:24.673470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.745724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd84c39-8557-4003-896e-e7b2e1c3938d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.755165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.785038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.785947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.786388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.786815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.787768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:24.788294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.789826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.804450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 291/604] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:24.805564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.816958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ad286-2c94-4363-8453-1b7e84df0c48 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.861660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.862374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.862646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.862920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.870200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.871553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:24.873201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:24.890693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:24.891839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:24.892891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:24.895599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 314/605] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:24.896781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:24.934709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123632-91df-4dfe-8ce1-d190812494a9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:24.980023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:24.981132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:24.981579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:24.981992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:24.982788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:24.983386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:24.985422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:24.999450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 292/606] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:24.999450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.031500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540ee82-1e68-4d02-ab41-f1b651f8a3be None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.051349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.072813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.073800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.074269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.074694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.082145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.083913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:25.096357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:25.097349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:25.098465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:25.100553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 315/607] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:25.101524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.123035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2c0df-74dc-4fa0-bd7a-52f275efc36e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.148204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.173347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.174650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.175159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.175738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.176768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:25.177364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.179594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.199449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 293/608] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:25.199449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.233586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68442ad-f12e-4a14-b2db-a1dec2bbf267 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.270090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.271096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.271597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.272149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.283903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.285706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:25.301559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:25.302568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:25.303536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:25.303536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:25.303536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:25.310720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 316/609] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:25.311895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.318987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bdd06-fb6c-4456-b1a6-2886d878c3fc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.346957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.359326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.359783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.360065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.360333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.361029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:25.361330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.362947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.381518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 294/610] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:25.382391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.421003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.427848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd87136-5c3b-4883-b435-5167c8f97aa2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.466127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.467208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.467858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.468357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/465160a7e1c24601b83be37681ef322d/roles/13b0eb7c0ad04dba9ae829944539f1f6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.484681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=465160a7e1c24601b83be37681ef322d, role_id=13b0eb7c0ad04dba9ae829944539f1f6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.486641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.492930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097aff6-e374-4268-8a2f-728b22153929 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.511855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 317/611] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:25 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/465160a7e1c24601b83be37681ef322d/roles/13b0eb7c0ad04dba9ae829944539f1f6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:25.513910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.540533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.541210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.541492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.542063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.542650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:25.542954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.546059 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.571176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 295/612] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:25.580033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.686486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.702633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:25.710492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2cbd1-e377-4a85-8591-c58ed49bd69b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.716632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477e4b6-0c26-4f9a-b14f-215a7caad3c8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.764132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.764785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.765062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.765331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.769054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab24a3-6bd9-4dde-bc35-f184bb5df7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.769888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab24a3-6bd9-4dde-bc35-f184bb5df7a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.770353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab24a3-6bd9-4dde-bc35-f184bb5df7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.770789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab24a3-6bd9-4dde-bc35-f184bb5df7a9 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/a3812df0dc174249acb139876f4302ab/roles/13b0eb7c0ad04dba9ae829944539f1f6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.772999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.774470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:25.789203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:25.790407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:25.791619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 296/613] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:58:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:25.795377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab24a3-6bd9-4dde-bc35-f184bb5df7a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=a3812df0dc174249acb139876f4302ab, role_id=13b0eb7c0ad04dba9ae829944539f1f6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:25.796601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:25.796907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab24a3-6bd9-4dde-bc35-f184bb5df7a9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:25.823556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 318/614] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:25 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/a3812df0dc174249acb139876f4302ab/roles/13b0eb7c0ad04dba9ae829944539f1f6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:25.843025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c611c-5ff6-45e3-969b-6b3d8631c84e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.843667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c611c-5ff6-45e3-969b-6b3d8631c84e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.844158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c611c-5ff6-45e3-969b-6b3d8631c84e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.845811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 319/615] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:25.852473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ed56-19d5-4483-bc9c-609090066046 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.852473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ed56-19d5-4483-bc9c-609090066046 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.852473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ed56-19d5-4483-bc9c-609090066046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.872556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2949ed56-19d5-4483-bc9c-609090066046 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:25.874231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2949ed56-19d5-4483-bc9c-609090066046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:25.928988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6a68-15f3-47fc-9d20-0af2c08ea14d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:25.977944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 320/616] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:25.996620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:25.997485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:25.997891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:25.998267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:25.999131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:25.999572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:26.001213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:26.027431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 297/617] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:58:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:26.027679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949ed56-19d5-4483-bc9c-609090066046 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:26.033923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:26.054892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:26.103741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:26.167633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949ed56-19d5-4483-bc9c-609090066046 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:26.185104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34217a2-ceb4-406a-b11e-5f30d5a9a8b0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:26.235139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:26.236210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:26.237244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:26.237807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:26.251436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b0769-cf5c-46f2-a29e-7e9c70998f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:26.252297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0769-cf5c-46f2-a29e-7e9c70998f31 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:26.252722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0769-cf5c-46f2-a29e-7e9c70998f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:26.253320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0769-cf5c-46f2-a29e-7e9c70998f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:26.259527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:26.265276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:26.266364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:26.267393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:26.269811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 321/618] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:26.276941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:26.399680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b0769-cf5c-46f2-a29e-7e9c70998f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:26.401157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b0769-cf5c-46f2-a29e-7e9c70998f31 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:26.420602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:26.455390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3b10-87df-4a00-95d7-0bbba1615e71 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:26.492502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:26.514261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:26.514870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:26.515140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:26.515405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:26.516092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:26.516388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:26.518727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:26.537236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 322/619] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:26.543953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:26.580783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 298/620] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 07:58:26.582050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477ed4-6732-4624-892c-2d2fd200cc23 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:26.582553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477ed4-6732-4624-892c-2d2fd200cc23 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:26.582553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477ed4-6732-4624-892c-2d2fd200cc23 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:26.587457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 299/621] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:26.587457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a477ed4-6732-4624-892c-2d2fd200cc23 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:26.666200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639df6-3bc5-4b09-aec5-67dbd07adf7d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:26.703179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f473b6-2e3f-46be-b7ab-c0a14885d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:26.704360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f473b6-2e3f-46be-b7ab-c0a14885d131 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:26.704825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f473b6-2e3f-46be-b7ab-c0a14885d131 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:26.705279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f473b6-2e3f-46be-b7ab-c0a14885d131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:26.717057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f473b6-2e3f-46be-b7ab-c0a14885d131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:26.719024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f473b6-2e3f-46be-b7ab-c0a14885d131 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:26.725800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a477ed4-6732-4624-892c-2d2fd200cc23 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-59f473b6-2e3f-46be-b7ab-c0a14885d131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:26.735729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:26.736694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:26.737629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:26.737629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:26.737629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:26.739529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 323/622] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:26.740818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b905b3-5e48-48bf-8321-86cdc1c62d4c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:26.741270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b905b3-5e48-48bf-8321-86cdc1c62d4c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:26.741711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b905b3-5e48-48bf-8321-86cdc1c62d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:26.746648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:26.763629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-39b905b3-5e48-48bf-8321-86cdc1c62d4c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:26.765020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-39b905b3-5e48-48bf-8321-86cdc1c62d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:26.772734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:26.773369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:26.773649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:26.774440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:26.790651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:26.792340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:26.800894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:26.808584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:26.809883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:26.810973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:26.810973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:26.810973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:26.812734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 300/623] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:26.813642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:26.859599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 324/624] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:26.864275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b905b3-5e48-48bf-8321-86cdc1c62d4c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:26.965171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cea3-1f71-461f-b18f-21a033e7ef80 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:26.985250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b905b3-5e48-48bf-8321-86cdc1c62d4c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.012280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.012998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.013834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.014211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.015383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:27.016074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.018222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.026004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.026880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.027357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.028405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.029237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:27.029788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.031385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.032592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 301/625] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:27.035769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.055239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 325/626] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:27.056195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.070805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.099442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.159318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905cd30-acad-4ad4-a582-601ed978df3e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.185522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594854b-fd29-4587-b206-f88d6e344f4e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.198490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.199594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.199922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.200306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.211642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:27.217749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:27.218697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:27.219562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:27.223739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 302/627] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:27.224567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.230748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.232219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.232696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.233166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.241759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.243829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:27.257160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:27.258137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:27.259093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:27.262793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 326/628] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:27.263817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.324373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.342321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48b80c-4021-4c21-9c68-08b047581835 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.375339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.384627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.386124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.386618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.387658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.394921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecfe50-4400-4af2-95d7-69d072b7b82c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.397291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.399795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:27.414509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:27.415485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:27.416431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:27.424073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 303/629] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:27.424772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.438581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.439562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.440002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.440407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.441214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:27.441672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.443372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.453966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 327/630] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:27.455058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.538487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cfaaa-8f45-4c51-af74-84c1359fedb9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.569568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cebc7d-694b-4ab1-b689-70908812a0cd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.576174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.576905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.577295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.577698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.578534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:27.578947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.580667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.605356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 304/631] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:27.607210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.610733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.611126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.612621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.613120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.613594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.614538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:27.614988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.616701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.635741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 328/632] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:27.636814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.647608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.722568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc070-4363-4388-9709-b324d8831b2f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.750201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d8299-5f31-4da6-9d3f-7a07de3550b7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.761034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.762202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.762745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.763230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.775260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.778360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.790649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.791213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.791551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.791864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:27.798335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:27.799324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:27.800268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:27.800268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:27.800268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:27.807464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.807464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.808728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 305/633] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:27.809838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:27.820741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:27.821746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:27.822662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:27.822662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:27.822662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:27.826957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 329/634] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:27.827854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.875094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.896331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:27.921759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7a758-d396-46d8-9ab8-ae8802eee11a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.943872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208325-b849-4a3e-9647-f16206c1a08f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:27.958452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.959061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.959328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.959618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.960332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=b4e95079af6b4768bc38709a8bdc27bf) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:27.960636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.962060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:27.979445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 306/635] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/role_assignments?user.id=b4e95079af6b4768bc38709a8bdc27bf&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:27.979445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:27.992862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f7420-1f20-457e-9cdc-99f545d8dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:27.993692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7420-1f20-457e-9cdc-99f545d8dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:27.994040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7420-1f20-457e-9cdc-99f545d8dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:27.994380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7420-1f20-457e-9cdc-99f545d8dfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:27.995032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f7420-1f20-457e-9cdc-99f545d8dfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:27.995336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f7420-1f20-457e-9cdc-99f545d8dfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:27.997584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f7420-1f20-457e-9cdc-99f545d8dfc9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.011112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 330/636] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:28.013227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a414412-62ba-432c-823c-c96b055cd807 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.013503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a414412-62ba-432c-823c-c96b055cd807 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.013833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a414412-62ba-432c-823c-c96b055cd807 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.015056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 331/637] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:28.019956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a414412-62ba-432c-823c-c96b055cd807 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.102539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e31470-6ff3-4eb6-b5d7-b71ac0bc6593 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.128459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.137944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a414412-62ba-432c-823c-c96b055cd807 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.144855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ba2a9-230a-439c-b6ab-ebe05a2be71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.145557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba2a9-230a-439c-b6ab-ebe05a2be71d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.145912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba2a9-230a-439c-b6ab-ebe05a2be71d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.146254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba2a9-230a-439c-b6ab-ebe05a2be71d None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.146964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba2a9-230a-439c-b6ab-ebe05a2be71d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:28.147269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba2a9-230a-439c-b6ab-ebe05a2be71d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:28.148694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba2a9-230a-439c-b6ab-ebe05a2be71d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.161868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.165739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 307/638] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:28.167101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cff34-41e0-49e2-9f3f-136581dc967c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.167518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cff34-41e0-49e2-9f3f-136581dc967c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.167891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cff34-41e0-49e2-9f3f-136581dc967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.187063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91a910-dd14-4d0f-8e50-95a112cf3e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.187771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91a910-dd14-4d0f-8e50-95a112cf3e81 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.188049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91a910-dd14-4d0f-8e50-95a112cf3e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.188319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91a910-dd14-4d0f-8e50-95a112cf3e81 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.188694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7d3cff34-41e0-49e2-9f3f-136581dc967c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:28.189955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7d3cff34-41e0-49e2-9f3f-136581dc967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:28.195774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91a910-dd14-4d0f-8e50-95a112cf3e81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:28.197201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91a910-dd14-4d0f-8e50-95a112cf3e81 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0b91a910-dd14-4d0f-8e50-95a112cf3e81 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:28.209009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:28.209997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 07:58:28.210949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:28.211575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 332/639] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:28.213031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a84d2-2cba-4165-9f74-242eeb26c67e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.213031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a84d2-2cba-4165-9f74-242eeb26c67e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.213236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a84d2-2cba-4165-9f74-242eeb26c67e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.214509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 333/640] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:28.215287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a84d2-2cba-4165-9f74-242eeb26c67e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.271246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 308/641] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:28.272243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cff34-41e0-49e2-9f3f-136581dc967c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.340476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a84d2-2cba-4165-9f74-242eeb26c67e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.377647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d99a6-575d-438a-b743-614bf8779b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.378189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d99a6-575d-438a-b743-614bf8779b4d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.378462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d99a6-575d-438a-b743-614bf8779b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.378729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d99a6-575d-438a-b743-614bf8779b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.380173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cff34-41e0-49e2-9f3f-136581dc967c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.385560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d99a6-575d-438a-b743-614bf8779b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:28.386994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d99a6-575d-438a-b743-614bf8779b4d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.392914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d05d99a6-575d-438a-b743-614bf8779b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:28.398216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:28.399230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 334/642] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:28.400614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9950e67-3924-42c7-b144-e6fb3d7877ba None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.401175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9950e67-3924-42c7-b144-e6fb3d7877ba None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.401175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9950e67-3924-42c7-b144-e6fb3d7877ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.420334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d9950e67-3924-42c7-b144-e6fb3d7877ba None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:28.421503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d9950e67-3924-42c7-b144-e6fb3d7877ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:28.427843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.428467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.428733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.429421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.430155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:28.430459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:28.432598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.451913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.453143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 309/643] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:28.454094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.497440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 335/644] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:28.508609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9950e67-3924-42c7-b144-e6fb3d7877ba None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.560205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fd195-ac48-42ca-a065-6ccd1ae77423 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.597054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.597681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.597960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.598232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.608892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:28.613584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:28.614699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 310/645] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:28.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.634617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9950e67-3924-42c7-b144-e6fb3d7877ba None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.647702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.673042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.673796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.674175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.674544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.675797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:28.676226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:28.677740 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.695868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 336/646] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:28.695868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.726194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.731632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b1e5-647c-45ac-a41c-c8cc144b3da0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.766818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.767444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.767722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.767991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.810164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1edef8-c6a6-4594-8fa5-d421a3e43464 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:28.839242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:28.841535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:28.852521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:28.853147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:28.853428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:28.853692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:28.864626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:28.869195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:28.869679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:28.870753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:28.871816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 337/647] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:28.872523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.956758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 311/648] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:28.956758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:28.968477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:28.982429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bebf1-b7fb-4b89-a6e5-64b1b78ddbd0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.019070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.019801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.020170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.020509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.021236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:29.021603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.023028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.036079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 338/649] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:29.036079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.062375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4a873-ea81-44ac-b561-896a22850d6a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.089720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:29.099632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.100681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.100855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.101130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/666116325de04177accd2bfece858554/roles/13b0eb7c0ad04dba9ae829944539f1f6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.115865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=666116325de04177accd2bfece858554, role_id=13b0eb7c0ad04dba9ae829944539f1f6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.117316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.132959 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 312/650] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:28 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/666116325de04177accd2bfece858554/roles/13b0eb7c0ad04dba9ae829944539f1f6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:29.134348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.155450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc4e4-ad44-4cd8-a053-bbc02275b95a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.196963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.197593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.197873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.198147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.198895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:29.199211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.201784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.211481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 339/651] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:29.212088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.232594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:29.329044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc5ed2-61ae-4128-9d9f-1bbf1e9b9864 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.333521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d319d-2be5-4cb3-9d5a-0b208858aafb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.364868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.365820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.366238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.366650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.373874 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47642-7396-41db-8be4-ad887298687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.374936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47642-7396-41db-8be4-ad887298687c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.375214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47642-7396-41db-8be4-ad887298687c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.375526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47642-7396-41db-8be4-ad887298687c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.378149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.380069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.388142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47642-7396-41db-8be4-ad887298687c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.390095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47642-7396-41db-8be4-ad887298687c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:29.397049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:29.398027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:29.398967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:29.398967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:29.398967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:29.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 313/652] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:29.405493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4df47642-7396-41db-8be4-ad887298687c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:29.410860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:29.412103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:29.413260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:29.413260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:29.413260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:29.416547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 340/653] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:29.417855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47642-7396-41db-8be4-ad887298687c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.443772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:29.511770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:29.534273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b22011-1cee-4f67-888b-e1841478936a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.559902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47642-7396-41db-8be4-ad887298687c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.569861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.570553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.570836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.571111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.582171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.583668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.597243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.597852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.598130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:29.598351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:29.599259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:29.600219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:29.600219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:29.600219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:29.600393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.600393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:29.600393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.600595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 314/654] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:29.600595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.601162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.619543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 341/655] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:29.620585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.689380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:29.708955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4006105-c311-4eea-9a61-d2583ea02c4e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.736198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ab0ad-16aa-4b09-a7aa-886a3de37e04 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.744004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.744610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.744886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.745135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.745942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:29.746069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.748073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.764870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 315/656] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:29.765190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:29.766039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.778406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.779308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.779774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.780192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.780979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:29.781530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.783211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.798803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 342/657] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:29.800097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.885591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9d3e-fb69-4a80-93d2-853685bfc97d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.927213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.928234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.928741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.929217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.929659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86959-684c-4a7a-a8ba-f69e402f7d7b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:29.938197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.940068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:29.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:29.954331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:29.955242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:29.962224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 316/658] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:29.963526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:29.968166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:29.979215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:29.979215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:29.979657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:29.979800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:29.989967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:29.992098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:30.007679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:30.008665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:30.009662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 343/659] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:30.015866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.082930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.089649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159b30f-3c95-4042-b96d-6a8265a3a140 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.131178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dded66-12ae-421e-a322-78733b60648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.131851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dded66-12ae-421e-a322-78733b60648e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.132125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dded66-12ae-421e-a322-78733b60648e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.132390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dded66-12ae-421e-a322-78733b60648e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.139580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dded66-12ae-421e-a322-78733b60648e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:30.141009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dded66-12ae-421e-a322-78733b60648e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.149782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f2d5-f064-47a9-8656-ebfc20fa1c73 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-50dded66-12ae-421e-a322-78733b60648e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:30.153590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:30.154614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:30.155686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 317/660] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:30.156346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dded66-12ae-421e-a322-78733b60648e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.187519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf3a15-ba22-4fe2-9248-efd2455711eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.188128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3a15-ba22-4fe2-9248-efd2455711eb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.188404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3a15-ba22-4fe2-9248-efd2455711eb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.188675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3a15-ba22-4fe2-9248-efd2455711eb None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.189366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf3a15-ba22-4fe2-9248-efd2455711eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:30.189671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf3a15-ba22-4fe2-9248-efd2455711eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:30.191088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf3a15-ba22-4fe2-9248-efd2455711eb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.208062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 344/661] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:30.208062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d56b-2f64-4649-ab9e-18d7e57ac825 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.208062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d56b-2f64-4649-ab9e-18d7e57ac825 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.208062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d56b-2f64-4649-ab9e-18d7e57ac825 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.208062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 345/662] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:30.208062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92d56b-2f64-4649-ab9e-18d7e57ac825 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.228533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.271469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dded66-12ae-421e-a322-78733b60648e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.315172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.315812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.316093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.316368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.317092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:30.317397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:30.318849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.326946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92d56b-2f64-4649-ab9e-18d7e57ac825 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.329709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.343801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 318/663] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:30.343801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.371105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec8e3-052b-4c6d-a5da-cb5bd31535a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.371773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec8e3-052b-4c6d-a5da-cb5bd31535a2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.372048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec8e3-052b-4c6d-a5da-cb5bd31535a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.372319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec8e3-052b-4c6d-a5da-cb5bd31535a2 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.373042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec8e3-052b-4c6d-a5da-cb5bd31535a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:30.373333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec8e3-052b-4c6d-a5da-cb5bd31535a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:30.374842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec8e3-052b-4c6d-a5da-cb5bd31535a2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.398540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 346/664] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:30.398540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42c05b-38f8-4c90-8c62-2e84c5eb94bb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.398540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42c05b-38f8-4c90-8c62-2e84c5eb94bb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.398540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42c05b-38f8-4c90-8c62-2e84c5eb94bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.414417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3a42c05b-38f8-4c90-8c62-2e84c5eb94bb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:30.415644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3a42c05b-38f8-4c90-8c62-2e84c5eb94bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:30.455763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d7ed-ae13-4016-b454-8acd5b600770 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.475932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.487506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 347/665] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:30.487506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42c05b-38f8-4c90-8c62-2e84c5eb94bb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.507566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.508400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.509009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.509733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.510513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=de7826aa1f8e4076ad5656f8cf7fe2e7) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:30.510824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:30.512544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.519041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 319/666] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/role_assignments?user.id=de7826aa1f8e4076ad5656f8cf7fe2e7&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:30.519767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.621560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.638817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42c05b-38f8-4c90-8c62-2e84c5eb94bb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.640949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c91ea-a33c-4edb-9db0-a1a7c02ed1df None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:30.679572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.680427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:30.680640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.681084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.681303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:30.681413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.681760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:30.682122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:30.749168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.775170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:30.775372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:30.776821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.777012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:30.891251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:30.898088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 320/667] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:30.899032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.904946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 348/668] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:30.910230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:30.987405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.004160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3ee37-2938-44d5-b2d5-c51c02a04f24 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.026738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a1e91-25a8-4eb1-9fd7-54433acb92b3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.039551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.040236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.040455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.040726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.051388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:31.055834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:31.057009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:31.058279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 321/669] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:31.059482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.070607 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.071516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.072059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.072534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.085161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.087114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:31.104243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:31.105503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:31.107016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:31.107016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:31.107016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:31.109335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 349/670] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:31.110485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.165421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b85d2-c698-434e-81c5-4d64260188af None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.201667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.202400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.202750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.203094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.203743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.213904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.215697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.218582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.224804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68afd-edbf-48d2-9f71-0224b8db6f6b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:31.234636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:31.235820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:31.236949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:31.236949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:31.236949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:31.238283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 322/671] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:31.239254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.265238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.265853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.266163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.266432 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.267088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:31.267383 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.268770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.281232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 350/672] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:31.282106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.348028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aa9b1-076e-485d-a4b3-0a51d87dd7cb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.383657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb389-01fd-44a0-861a-9d0016ea8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.384263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb389-01fd-44a0-861a-9d0016ea8caf None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.384547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb389-01fd-44a0-861a-9d0016ea8caf None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.384816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb389-01fd-44a0-861a-9d0016ea8caf None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.385451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb389-01fd-44a0-861a-9d0016ea8caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:31.385751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb389-01fd-44a0-861a-9d0016ea8caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.387212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb389-01fd-44a0-861a-9d0016ea8caf None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.392694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfecf14-a690-498d-9998-e5f97bcbaaf8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.399751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 323/673] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:31.400635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.400913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350a374-0aaf-4102-b749-78d56bc1190a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.401200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350a374-0aaf-4102-b749-78d56bc1190a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.401470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350a374-0aaf-4102-b749-78d56bc1190a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.407335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 324/674] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:31.407335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350a374-0aaf-4102-b749-78d56bc1190a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.435640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.436162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.436434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.436725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.437338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:31.437633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.439038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.454384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 351/675] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:31.454384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.470331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.517648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350a374-0aaf-4102-b749-78d56bc1190a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.556008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b49ed-eb3a-4e56-a456-5cb1d09cc4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.556637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b49ed-eb3a-4e56-a456-5cb1d09cc4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.557059 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b49ed-eb3a-4e56-a456-5cb1d09cc4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.557337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b49ed-eb3a-4e56-a456-5cb1d09cc4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.564267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d6085-a916-48b0-891b-08559761faae None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.569402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b49ed-eb3a-4e56-a456-5cb1d09cc4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.570848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b49ed-eb3a-4e56-a456-5cb1d09cc4d1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-cc1b49ed-eb3a-4e56-a456-5cb1d09cc4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:31.590538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:31.591547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:31.592471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:31.592471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:31.592471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:31.592471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 325/676] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:31.593678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e27351-bc33-40c6-90cd-c86d41f74671 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.593962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e27351-bc33-40c6-90cd-c86d41f74671 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.594234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e27351-bc33-40c6-90cd-c86d41f74671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.603178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.603935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.604215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.604488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.611602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.613020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.613264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c1e27351-bc33-40c6-90cd-c86d41f74671 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:31.614484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c1e27351-bc33-40c6-90cd-c86d41f74671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:31.625480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:31.626592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:31.627822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:31.631470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 352/677] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:31.632284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.662121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.690289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 326/678] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:31.691186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e27351-bc33-40c6-90cd-c86d41f74671 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.744646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.744845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28716e-0d3b-4b6a-81eb-e3b6fc6e522a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.785739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.786450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.786655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.786924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.799061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.801422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:31.814906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:31.820516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 353/679] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:31.821558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.826263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e27351-bc33-40c6-90cd-c86d41f74671 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.866629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.867332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.867710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.868056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.868762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:31.869067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.870526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.886785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 327/680] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:31.886785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.915186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.932525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478788d-0e8a-40c3-85d7-bd57b6c9fa54 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:31.971780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:31.972472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:31.972744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:31.973312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:31.974005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:31.974313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:31.976165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:31.985936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:31.994123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 354/681] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:31.994123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:31.994386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f640dc-aed7-4401-9ab7-c01ecf478f9b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.030726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.031341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.031665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.031937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.042280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:32.047848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:32.048806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 328/682] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:32.049775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.106888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2cafb-5c96-4c79-8241-a7b40375f896 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.143593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.144195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.144473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.144744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.145431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:32.145732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.147245 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.157303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc6a6-b53e-4559-a2ce-f41d7d705ab9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.160182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 355/683] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:32.160580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.172792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:32.199509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.200628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.200969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.201168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.208938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.210382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:32.222883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:32.224065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:32.225349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:32.228602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 329/684] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:32.229408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.251407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:32.272990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879c81f-7eef-4d80-bdd9-0b09f1ca8314 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.313915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.314529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.314805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.315075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.315836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=a3812df0dc174249acb139876f4302ab) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:32.316144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.317563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.331476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 356/685] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/role_assignments?user.id=a3812df0dc174249acb139876f4302ab&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:32.331476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.362357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02d1ef-9bf0-4d9d-b85e-0f9f7788a30b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.401162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:32.412077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.413036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.413648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.414069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.415624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:32.416110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.418200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.434398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 330/686] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:32.435803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.438627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99e39b-6c40-4ed2-9baa-e88356b1ed9f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.480350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.481528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.481975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.482393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.483282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=465160a7e1c24601b83be37681ef322d) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:32.483762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.485477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.492813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 357/687] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/role_assignments?user.id=465160a7e1c24601b83be37681ef322d&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:32.500624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.572527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:32.582833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c38d-8b24-4170-b9d8-0e3bbbe00daf None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.633936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.634557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.634829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.635096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.635877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:32.636179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.638269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.650206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38f558-2f0b-49df-b159-8dc9d3e32d13 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.657495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 331/688] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:32.663374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.689419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.690359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.690774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.691225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.695987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:32.709205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.710920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:32.728968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:32.729970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:32.731531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:32.731531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:32.731531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:32.733317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 358/689] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:32.740023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:32.864606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad35ad-090b-43e3-adb8-5031b147dd57 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.898893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493de57-5e88-4a37-a550-72afbf04ec97 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:32.938026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38b1e7-e549-43ab-b6b0-0539f958f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.939046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38b1e7-e549-43ab-b6b0-0539f958f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.939580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38b1e7-e549-43ab-b6b0-0539f958f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.940005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38b1e7-e549-43ab-b6b0-0539f958f7b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.940873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38b1e7-e549-43ab-b6b0-0539f958f7b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:32.941238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:32.941448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38b1e7-e549-43ab-b6b0-0539f958f7b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:32.941842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:32.942116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:32.942387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:32.943372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38b1e7-e549-43ab-b6b0-0539f958f7b0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:32.956985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.069465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.071206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.093273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 359/690] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:33.094615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ba788-1a69-4a1b-b13e-0b58b7ffe1c4 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.094895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ba788-1a69-4a1b-b13e-0b58b7ffe1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.095162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ba788-1a69-4a1b-b13e-0b58b7ffe1c4 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.096788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 360/691] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:33.109026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf81b9-dd9d-47b0-8e84-11cf3d3a53f0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.109304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf81b9-dd9d-47b0-8e84-11cf3d3a53f0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.109571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf81b9-dd9d-47b0-8e84-11cf3d3a53f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.128411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6bbf81b9-dd9d-47b0-8e84-11cf3d3a53f0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:33.129716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6bbf81b9-dd9d-47b0-8e84-11cf3d3a53f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:33.193483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.203697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 332/692] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:33.204987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.250708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.283557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 361/693] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:33.284736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf81b9-dd9d-47b0-8e84-11cf3d3a53f0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.322118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d606a9-699d-46e3-867f-04f6318a6052 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.367030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.368454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.368993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.369571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] PATH_INFO: `/v3/users/swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.378682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.380452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:33.394076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:33.395076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:33.396067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:33.398956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 333/694] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:33.400004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.474465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf81b9-dd9d-47b0-8e84-11cf3d3a53f0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.511391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.512220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.512507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.513344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.518773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.525451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d767e86-d964-430f-ae95-978d33e06aab None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.525614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.526918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:33.545965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:33.547155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:33.548843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:33.548843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:33.548843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:33.548843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 362/695] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:33.548843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.576911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.578275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.578827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.579536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.584175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.596175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.598136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:33.616704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:33.617743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:33.618652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:33.618652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:33.618652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:33.618652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 334/696] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:33.618652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.686942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44eb85-bce3-476f-922d-4e05017fc089 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.733091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.734320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.735185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.735958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.736889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:33.737387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.737606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb847e-febd-40d9-9031-eca55ddac063 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.739546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.762925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 363/697] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:33.764463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.780435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.781303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.781444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.781688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.782341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:33.782636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.784167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.798474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 335/698] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:33.799576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.814322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.873314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:33.890465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea64c4-188c-4c55-8855-3414ba56bab5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.913771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddedfe-3629-4c69-9638-5d076f727a2a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:33.927062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.928397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.928972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.929434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:33.930269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:33.930766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:33.932541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:33.950631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 364/699] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:33.950631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:33.954179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:33.954788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:33.955062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:33.955328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.027939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.029529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.040942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:34.072681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32e157-c3bf-483e-af50-ce34867c2352 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.108916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.109969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.110474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.111058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.118498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.120342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:34.133403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:34.134345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:34.135227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:34.136546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 336/700] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:34.137479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.137699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 365/701] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:34.143530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.153714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:34.247017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a25bd1-cdf3-4d52-b19a-bf9d926be931 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.255521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3e24-cf83-477a-b5b3-6e2c00c3ea5d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.259227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:34.285254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.285893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.286348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.286497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.287133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.288595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.295789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.296641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.297087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.297551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.313699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 337/702] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:58:34 2022] POST /identity/v3/users => generated 254 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:34.314528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.315709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.317593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:34.334352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:34.335384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:34.336337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:34.336337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:34.336337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:34.343128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 366/703] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:34.345152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.412387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:34.435772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e346a-dd58-4af5-b8bf-82532a0ba468 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.461295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351978-ddc5-4d68-896b-5b0837ee1abd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.474466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.475245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.475519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.475831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.476530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:34.476884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.478247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.493360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 338/704] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:34.501903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.503943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.504726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.505184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.505817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.506748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:34.507275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.508890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.526951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 367/705] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:34.529404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.567144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:34.640708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549a54-848c-4fba-8f3d-714199cf26cc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.661197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:34.672258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481b7c-8d1b-474b-969d-1eb6e04abe0c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.679846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.680820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.681312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.681810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.690264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.692006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:34.704506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:34.705436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:34.706344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:34.713451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 368/706] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:34.715611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.717915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d64291-ceef-4b0d-84f1-9018aaa79e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.718522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64291-ceef-4b0d-84f1-9018aaa79e19 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.718795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64291-ceef-4b0d-84f1-9018aaa79e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.719063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64291-ceef-4b0d-84f1-9018aaa79e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.719892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64291-ceef-4b0d-84f1-9018aaa79e19 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=b4e95079af6b4768bc38709a8bdc27bf) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:34.720195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64291-ceef-4b0d-84f1-9018aaa79e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.721643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64291-ceef-4b0d-84f1-9018aaa79e19 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.728229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 339/707] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:34 2022] GET /identity/v3/role_assignments?user.id=b4e95079af6b4768bc38709a8bdc27bf&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:34.737452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a091-2da3-4df7-a559-979dc8656a07 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.737890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a091-2da3-4df7-a559-979dc8656a07 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.738258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a091-2da3-4df7-a559-979dc8656a07 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.740249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 340/708] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:34.746029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a33e1-c282-4ca5-90a0-ac00efebadef None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.747089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a33e1-c282-4ca5-90a0-ac00efebadef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.748130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a33e1-c282-4ca5-90a0-ac00efebadef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.770234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-df1a33e1-c282-4ca5-90a0-ac00efebadef None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:34.771759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-df1a33e1-c282-4ca5-90a0-ac00efebadef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:34.837619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe09856-7369-436d-96c2-6c7313dcd481 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:34.880631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:34.881615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.882084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.882567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.883580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:34.884094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:34.885810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:34.907531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 369/709] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:34.911606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:34.962710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:34.985873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 341/710] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:34.987316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f281e4-f49f-4aa4-b988-5881232fd1b5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.987768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f281e4-f49f-4aa4-b988-5881232fd1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.988089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f281e4-f49f-4aa4-b988-5881232fd1b5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:34.989656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 342/711] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:34.995352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ee211-36bf-43ba-9737-b8a0d009bc5c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:34.995685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ee211-36bf-43ba-9737-b8a0d009bc5c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:34.996072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ee211-36bf-43ba-9737-b8a0d009bc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.017576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b09ee211-36bf-43ba-9737-b8a0d009bc5c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:35.018819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b09ee211-36bf-43ba-9737-b8a0d009bc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:35.029688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8a59-1c82-445b-a9b1-58d4da04f55d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:35.035081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:35.066694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:35.067604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:35.068054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:35.068487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.069353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=666116325de04177accd2bfece858554) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:35.069807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:35.071632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:35.083543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 370/712] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:34 2022] GET /identity/v3/role_assignments?user.id=666116325de04177accd2bfece858554&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:35.084775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:35.092901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 343/713] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:35.115880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ee211-36bf-43ba-9737-b8a0d009bc5c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:35.210060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a2fe-42d5-4178-8a77-af5bc2e11a05 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:35.213593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:35.247607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ee211-36bf-43ba-9737-b8a0d009bc5c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:35.255122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:35.256201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:35.256706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:35.257203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] PATH_INFO: `/v3/services/network` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.258015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:35.259684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:35.273836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:35.275822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:35.276803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:35.281814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 371/714] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:35 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:35.288406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:35.289015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:35.289228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:35.289492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.290083 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:35.290798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:35.294181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:35.307099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:35.308471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:35.309461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 344/715] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 10 07:58:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:35.315484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:35.332707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:35.460129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991196a9-464c-4ed4-8c53-62678d61c926 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:35.462205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a059-1267-47e2-853b-465ef72b3734 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:35.513075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:35.513273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:35.513633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:35.513905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:35.514169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.514804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:35.514910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] RBAC: Adding query filter params (name=network) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:35.515151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:35.515672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:35.516333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.516603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:35.517456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:35.518143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:35.520394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:35.522616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 372/716] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:58:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:35.528078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:35.533579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 345/717] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 07:58:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:35.538912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:35.581016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:35.641785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:35.670901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001c0a7-e687-49b3-996b-cc9645d3d1df None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:35.680128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456bb61-ae57-4fce-96af-b4223c44bf34 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:35.722888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8906c-5eee-4f56-aa62-13ec9e9a5f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:35.722888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8906c-5eee-4f56-aa62-13ec9e9a5f8f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:35.722888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8906c-5eee-4f56-aa62-13ec9e9a5f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:35.722888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8906c-5eee-4f56-aa62-13ec9e9a5f8f None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.723319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8906c-5eee-4f56-aa62-13ec9e9a5f8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:35.723780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8906c-5eee-4f56-aa62-13ec9e9a5f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:35.724752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8906c-5eee-4f56-aa62-13ec9e9a5f8f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:35.734010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f00f0-2da7-428a-9c05-26dd260beeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:35.734609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f00f0-2da7-428a-9c05-26dd260beeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:35.734880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f00f0-2da7-428a-9c05-26dd260beeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:35.735147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f00f0-2da7-428a-9c05-26dd260beeb9 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:35.735792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f00f0-2da7-428a-9c05-26dd260beeb9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:35.736127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f00f0-2da7-428a-9c05-26dd260beeb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:35.737426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f00f0-2da7-428a-9c05-26dd260beeb9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:35.740491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 346/718] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 07:58:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:35.745229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 373/719] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:58:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:36.969160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf422-6325-419e-95e2-3cda6281a27c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:36.970430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf422-6325-419e-95e2-3cda6281a27c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:36.971238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf422-6325-419e-95e2-3cda6281a27c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:36.973497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 347/720] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:36.979291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96f33-6b9e-4ad3-b7ef-9ca4ec582a9f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:36.980157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96f33-6b9e-4ad3-b7ef-9ca4ec582a9f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:36.980871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96f33-6b9e-4ad3-b7ef-9ca4ec582a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:36.999784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bcb96f33-6b9e-4ad3-b7ef-9ca4ec582a9f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:37.001278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bcb96f33-6b9e-4ad3-b7ef-9ca4ec582a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:37.079529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 374/721] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:37.096689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf422-6325-419e-95e2-3cda6281a27c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:37.207904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf422-6325-419e-95e2-3cda6281a27c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:37.245181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b759-9503-4d09-b328-3267390074a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:37.246778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b759-9503-4d09-b328-3267390074a6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:37.247525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b759-9503-4d09-b328-3267390074a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:37.248053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b759-9503-4d09-b328-3267390074a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:37.258938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b759-9503-4d09-b328-3267390074a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-95d0b759-9503-4d09-b328-3267390074a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:37.263956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:37.264948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:37.265877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:37.271320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 348/722] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:37.274969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96f33-6b9e-4ad3-b7ef-9ca4ec582a9f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:37.302295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:37.384851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96f33-6b9e-4ad3-b7ef-9ca4ec582a9f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:37.414698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c804-69d6-43cf-8afa-d54559bbabde None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:37.415020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c804-69d6-43cf-8afa-d54559bbabde None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:37.415248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c804-69d6-43cf-8afa-d54559bbabde None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:37.416598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 349/723] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:37.424573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6da93-1edc-40c9-ba50-9ee52e9f2b1f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:37.424850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6da93-1edc-40c9-ba50-9ee52e9f2b1f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:37.425121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6da93-1edc-40c9-ba50-9ee52e9f2b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:37.431772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:37.440414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:37.441035 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:37.441314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:37.441590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:37.442263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:37.442566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:37.443973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:37.451688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d7c6da93-1edc-40c9-ba50-9ee52e9f2b1f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:37.453384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d7c6da93-1edc-40c9-ba50-9ee52e9f2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:37.460074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 375/724] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:37.469612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:37.542007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 350/725] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 07:58:37.572298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6da93-1edc-40c9-ba50-9ee52e9f2b1f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:37.623082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:37.657327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de693e0-373c-44e5-ace4-c2692a7ccbe2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:37.712493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6da93-1edc-40c9-ba50-9ee52e9f2b1f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:37.747053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:37.753229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:37.753866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:37.754160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:37.754506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:37.755212 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:37.756197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:37.756672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:37.757139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:37.766795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:37.771970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:37.772963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:37.773828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 351/726] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:37.781319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:37.785894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:37.787537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:37.814515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:37.815732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:37.816864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:37.816864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:37.816864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:37.823596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 376/727] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:37.827650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:37.950374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c64b8-4c7d-41bb-8f7a-f39a9e7578c2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:37.963130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371cc55-0147-41c7-9285-ce7ad10b524e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:37.995054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a343172-565c-4cdc-bc7c-9d8ca1ddf8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:37.995767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a343172-565c-4cdc-bc7c-9d8ca1ddf8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:37.996020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a343172-565c-4cdc-bc7c-9d8ca1ddf8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:37.996798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a343172-565c-4cdc-bc7c-9d8ca1ddf8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:37.997464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a343172-565c-4cdc-bc7c-9d8ca1ddf8b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:37.997763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a343172-565c-4cdc-bc7c-9d8ca1ddf8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:37.999129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a343172-565c-4cdc-bc7c-9d8ca1ddf8b4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.008060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 352/728] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:38.013843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f8627-d734-4701-a492-1096b5e7951c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.013843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f8627-d734-4701-a492-1096b5e7951c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.013843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f8627-d734-4701-a492-1096b5e7951c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.013843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 353/729] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:38.014632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f8627-d734-4701-a492-1096b5e7951c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.018890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e7584-e29f-42d5-b0f1-c6733fe65a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.019553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e7584-e29f-42d5-b0f1-c6733fe65a28 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.019832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e7584-e29f-42d5-b0f1-c6733fe65a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.020099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e7584-e29f-42d5-b0f1-c6733fe65a28 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.021738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e7584-e29f-42d5-b0f1-c6733fe65a28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:38.022028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e7584-e29f-42d5-b0f1-c6733fe65a28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.023428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e7584-e29f-42d5-b0f1-c6733fe65a28 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.033398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.039710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 377/730] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:38.041208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b879-28ea-4425-95ae-21b2e5fefcc2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.041882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b879-28ea-4425-95ae-21b2e5fefcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.042152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b879-28ea-4425-95ae-21b2e5fefcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.064471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0fb4b879-28ea-4425-95ae-21b2e5fefcc2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:38.065989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0fb4b879-28ea-4425-95ae-21b2e5fefcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:38.096567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.150942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f8627-d734-4701-a492-1096b5e7951c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.158116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 378/731] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:38.159774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4b879-28ea-4425-95ae-21b2e5fefcc2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.189801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.190483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.191111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.191111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.203019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.204547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:38.222282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:38.223324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:38.224739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:38.224739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:38.224739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:38.224739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 354/732] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:38.224739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.299880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4b879-28ea-4425-95ae-21b2e5fefcc2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.332145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.341381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c7d2-5659-4c0a-b1a9-9c061e0f0f2e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.341879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.342502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.342935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.343209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.348324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.355594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.357709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:38.373182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:38.374162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:38.375108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 379/733] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:38.376286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.380810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e769d1-e9d5-42aa-82db-cb47e64e0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.381452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e769d1-e9d5-42aa-82db-cb47e64e0711 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.381727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e769d1-e9d5-42aa-82db-cb47e64e0711 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.381991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e769d1-e9d5-42aa-82db-cb47e64e0711 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.394047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e769d1-e9d5-42aa-82db-cb47e64e0711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b9e769d1-e9d5-42aa-82db-cb47e64e0711 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:38.399246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:38.400199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:38.401139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 355/734] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:38.401837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c14f-ec21-499b-b626-d86873e9a8b9 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.401837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c14f-ec21-499b-b626-d86873e9a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.402695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c14f-ec21-499b-b626-d86873e9a8b9 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.407396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 356/735] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:38.407396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c14f-ec21-499b-b626-d86873e9a8b9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.489366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c099-4c57-445e-943c-f0466c94a1a1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.515041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c14f-ec21-499b-b626-d86873e9a8b9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.529261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.529900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.530211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.530513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.531202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:38.531530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.533004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.545769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 380/736] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:38.546541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.550254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a579b-130e-44f4-a137-b1171ffa7e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.550913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a579b-130e-44f4-a137-b1171ffa7e9f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.551198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a579b-130e-44f4-a137-b1171ffa7e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.551508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a579b-130e-44f4-a137-b1171ffa7e9f None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.552245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a579b-130e-44f4-a137-b1171ffa7e9f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:38.552547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a579b-130e-44f4-a137-b1171ffa7e9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.553977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a579b-130e-44f4-a137-b1171ffa7e9f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.571937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 357/737] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:38.573190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d561-2874-486e-a100-e93f14263df7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.573471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d561-2874-486e-a100-e93f14263df7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.573743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d561-2874-486e-a100-e93f14263df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.590733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5bd2d561-2874-486e-a100-e93f14263df7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:38.591872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5bd2d561-2874-486e-a100-e93f14263df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:38.595584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.609498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.647780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad343756-87ce-4fff-a015-22e7f82dee9c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.658246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 358/738] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:38.659496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf0f8-54b2-4e2e-b790-44c05e7c7434 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.659776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf0f8-54b2-4e2e-b790-44c05e7c7434 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.660038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf0f8-54b2-4e2e-b790-44c05e7c7434 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.661386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 359/739] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:38.661921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbf0f8-54b2-4e2e-b790-44c05e7c7434 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.691291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.691956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.692235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.692510 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.693190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:38.693492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.694869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.703387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 381/740] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:38.704337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.774589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbf0f8-54b2-4e2e-b790-44c05e7c7434 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.804276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508cb73-7965-4c08-82b8-87456b11a188 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:38.809617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0acf9-cac1-476c-b793-9c0e2a28a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.810323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0acf9-cac1-476c-b793-9c0e2a28a5ab None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.810612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0acf9-cac1-476c-b793-9c0e2a28a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.810880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0acf9-cac1-476c-b793-9c0e2a28a5ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.815341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.817883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0acf9-cac1-476c-b793-9c0e2a28a5ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.819395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0acf9-cac1-476c-b793-9c0e2a28a5ab None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-14d0acf9-cac1-476c-b793-9c0e2a28a5ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:38.831128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:38.832301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:38.833317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 360/741] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:38.833916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50d01f-23b8-4328-a9a7-44516a89a0d0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.834148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50d01f-23b8-4328-a9a7-44516a89a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.834436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50d01f-23b8-4328-a9a7-44516a89a0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.846156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:38.846716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:38.847013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:38.847286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:38.852076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-da50d01f-23b8-4328-a9a7-44516a89a0d0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:38.853250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-da50d01f-23b8-4328-a9a7-44516a89a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:38.863311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:38.923892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 361/742] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 07:58:38.924725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50d01f-23b8-4328-a9a7-44516a89a0d0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:38.927328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:38.928963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.026518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 382/743] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 07:58:39.027902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.038467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50d01f-23b8-4328-a9a7-44516a89a0d0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.039669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.073151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.073750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.074118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.074896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.075575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.076979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.092058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 362/744] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:58:38 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:39.093396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.097893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.159491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7cc2-c6c4-4d83-b95a-a0a2ced0e57a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.214660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b061b-f495-40e3-9c74-c2673511c6b0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.215513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.216596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.217123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.217665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.229760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.231753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:39.249295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:39.250328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:39.251278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:39.251278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:39.251278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:39.251278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 383/745] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:39.251278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.258809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.259440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.259750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.260027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.260766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:39.261065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.263112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.281215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 363/746] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:39.282004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.327574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.352745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.389501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bf6c4-0324-41b6-874a-8990abadb4f4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.396442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacf6a4-13a1-4239-8ff5-9b95e8f20ab4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.425779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.426388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.426664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.426933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.427670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.429048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.433119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.434448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.434830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.435127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.446160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.446626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 384/747] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:58:39 2022] POST /identity/v3/services => generated 240 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:39.447496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.447737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:39.468318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:39.469445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:39.470376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:39.470376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:39.470376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:39.474680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 364/748] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:39.475709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.603895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d5301-01a1-41c9-a7e0-768c43b025f5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.609353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6186-cfd8-489f-97f0-6e2ed7d1d229 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.617489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.627544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.659267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.660117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.660228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.660425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.660573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.661099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:39.661195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.661397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.661495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.661671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.662751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.676272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 385/749] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:39.677186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.678938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.680586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:39.701273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:39.702479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:39.703596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:39.703596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:39.703596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:39.703596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 365/750] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:39.703596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.794848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b2e6-61ad-435b-b6dc-ceebe67d7dd3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.817020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e68e4-de98-4a85-a8d8-efcbd6c45edb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:39.830291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.831186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.831595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.831965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.832789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:39.833183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.834748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.848703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 386/751] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:39.849866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.856780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:39.857618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:39.858041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:39.858476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:39.867074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:39.868832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:39.883299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:39.884503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:39.885614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:39.887890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 366/752] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:39.888873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:39.890335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.923041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:39.970198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac92678-fa95-4123-bda7-4653076e21b5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.006597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffc499-e59d-467d-85ca-c222ad451136 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.009151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.009868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.010243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.010624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.011359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:40.013026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.014518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.028387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 387/753] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:40.029548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.043215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.044059 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.044335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.044657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.051819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.053311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:40.065646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:40.066649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:40.067798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 367/754] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:40.068422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.150203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:40.158011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa7bc3-39d5-457a-bed0-50f17f82a8c2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.171794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:40.180348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd293-6363-4c1e-93d5-820309277900 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.195866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.196604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.196983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.197339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.198378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:40.198564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.200782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.223484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.223775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 388/755] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:40.223775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.224228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.224440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.224687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.234042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.235796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:40.247777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:40.248803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 368/756] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:40.250297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.368087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70cefe-433a-4e9d-9305-e725a0aa231e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.387824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda0ee-557b-4f73-a7b7-31aeccc6fad2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.414556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.415226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.415627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.416226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.417032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:40.417890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.419877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.426744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.427573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.428106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.428559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.442956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 389/757] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:40.444050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.448108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:40.472237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:40.516883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.518398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.587965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256df5a7-b086-41fc-9491-49b0ecfea693 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.643623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.645463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.645977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.646422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.647978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:40.648699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.650322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.651654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 369/758] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:58:40.653298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.671293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 390/759] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:40.671293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.717162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:40.753694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:40.787766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7b98-f503-45e8-bdb6-89c8a0b7dc45 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.798751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851d75-ac69-45a6-9df0-c622fda18189 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:40.825002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.825663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.825942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.826216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.838051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.839765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.844370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:40.845243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:40.845743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:40.846207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:40.847622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=3a5c88198c71414e99118fe595ad002c) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:40.848595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:40.850481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:40.854965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:40.856461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:40.857362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:40.857362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:40.857362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:40.857362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 391/760] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:40.858055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:40.866228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 370/761] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/role_assignments?user.id=3a5c88198c71414e99118fe595ad002c&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:40.866228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:41.047684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b509-7ca5-4c46-bb87-de014a5dd9e7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:41.080355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc01e-fe58-4b61-a113-3293b09a83ee None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:41.088856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:41.095239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:41.111287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:41.112189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.112833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.113270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/b4e95079af6b4768bc38709a8bdc27bf/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.116349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=b4e95079af6b4768bc38709a8bdc27bf, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:41.118661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:41.128675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:41.128675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.128675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.128675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.129325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:41.129325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:41.130693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:41.144003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 392/762] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:40 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/b4e95079af6b4768bc38709a8bdc27bf/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:41.145874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 371/763] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:41.151094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:41.272716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76285579-ad3f-475f-b106-319d92780bf1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:41.319271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7182c-cc4e-4cdc-9ddf-03b8d3333ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:41.320018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7182c-cc4e-4cdc-9ddf-03b8d3333ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.320301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7182c-cc4e-4cdc-9ddf-03b8d3333ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.320632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7182c-cc4e-4cdc-9ddf-03b8d3333ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.328575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7182c-cc4e-4cdc-9ddf-03b8d3333ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:41.330027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7182c-cc4e-4cdc-9ddf-03b8d3333ce8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-08c7182c-cc4e-4cdc-9ddf-03b8d3333ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:41.348399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:41.349441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:41.350339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:41.352242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 393/764] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:41.357834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:41.421386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b925b-ad5f-4b30-ac45-66e4b602a440 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.421702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b925b-ad5f-4b30-ac45-66e4b602a440 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.422386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b925b-ad5f-4b30-ac45-66e4b602a440 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.424402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 394/765] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:41.430058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8092-89a3-46f9-9ca2-f85cee54d35b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.430591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8092-89a3-46f9-9ca2-f85cee54d35b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.430914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8092-89a3-46f9-9ca2-f85cee54d35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.464053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ba9d8092-89a3-46f9-9ca2-f85cee54d35b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:41.466208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ba9d8092-89a3-46f9-9ca2-f85cee54d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:41.509710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f26b-ab25-4476-b838-b5457cd4e026 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:41.518203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:41.550036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:41.550683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.551091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.551288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.551521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 395/766] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:58:41.551928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:41.552223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:41.553644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:41.570868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 372/767] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:41.577203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8092-89a3-46f9-9ca2-f85cee54d35b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:41.584485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:41.623255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:41.711406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9901f-c80e-4412-9987-b643f80e2bbe None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:41.716535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8092-89a3-46f9-9ca2-f85cee54d35b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:41.753027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d8de7-ee18-40a0-bfbe-425b2d7572fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:41.753638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8de7-ee18-40a0-bfbe-425b2d7572fe None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.753914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8de7-ee18-40a0-bfbe-425b2d7572fe None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.754185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8de7-ee18-40a0-bfbe-425b2d7572fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.755164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d8de7-ee18-40a0-bfbe-425b2d7572fe None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=666116325de04177accd2bfece858554) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:41.755591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d8de7-ee18-40a0-bfbe-425b2d7572fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:41.757135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d8de7-ee18-40a0-bfbe-425b2d7572fe None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:41.757884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:41.758508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.758784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.759324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.759994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:41.762844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:41.764229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 396/768] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:41 2022] GET /identity/v3/role_assignments?user.id=666116325de04177accd2bfece858554&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:41.765526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dae61-82b1-4558-8860-67dd7078633c None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.765876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dae61-82b1-4558-8860-67dd7078633c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.766220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dae61-82b1-4558-8860-67dd7078633c None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.771531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 397/769] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:41.772408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:41.773431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:41.775449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:41.777835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30983bbe-5ac6-4b2d-bd3e-4807da1965a2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.777835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30983bbe-5ac6-4b2d-bd3e-4807da1965a2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.778132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 373/770] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 10 07:58:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:41.778285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30983bbe-5ac6-4b2d-bd3e-4807da1965a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.783447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:41.793845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-30983bbe-5ac6-4b2d-bd3e-4807da1965a2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:41.795095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-30983bbe-5ac6-4b2d-bd3e-4807da1965a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:41.830124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:41.883468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 398/771] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:41.909042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:41.921005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30983bbe-5ac6-4b2d-bd3e-4807da1965a2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:41.921693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47911-fcb3-46c5-aa45-f06263ea98eb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:41.974412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:41.975031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:41.975579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:41.975856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:41.976895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:41.977193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:41.978631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:41.986358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 374/772] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 07:58:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:41.991896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:42.031500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30983bbe-5ac6-4b2d-bd3e-4807da1965a2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:42.068629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:42.069412 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:42.069591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:42.069809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:42.070630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:42.072025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:42.080971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:42.083329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:42.084331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 399/773] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:41 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:42.091634 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:42.102973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d40ab-78d1-4555-9d94-cec3d3d0176e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:42.141441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:42.142151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:42.142527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:42.143062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:42.143331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:42.144002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:42.144352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:42.145722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:42.151843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 375/774] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 07:58:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:42.158593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:42.179973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:42.268430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8c32-efb0-4a18-826f-f8cb5f90e4d3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:42.271550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b2c4-6a26-430e-bf2a-f9bc1807bb87 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:42.317260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:42.318750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:42.319886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:42.320160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:42.320861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] RBAC: Adding query filter params (interface=public, service_id=7cabda770bdd44e1a13e140da0295d43, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:42.321166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:42.322530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:42.337251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 376/775] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 07:58:42 2022] GET /identity/v3/endpoints?service_id=7cabda770bdd44e1a13e140da0295d43&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:42.343285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:42.345889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:42.346562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:42.346835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:42.347104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:42.347812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:42.348113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:42.349481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:42.365342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 400/776] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:58:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:42.371894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:42.513171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:42.538633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e2e2-2c26-4028-9158-61c52d7e2d97 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:42.543971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:42.555310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd0b0-d872-4e4b-bb0c-3c5fc29ecac7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:42.577657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:42.578304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:42.578589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:42.578857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:42.579479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:42.580850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:42.586373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 377/777] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:58:42 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:42.622974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:42.623553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:42.623833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:42.624106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:42.624763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] RBAC: Adding query filter params (type=network) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:42.625066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:42.626458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:42.636172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 401/778] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:58:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:42.642377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:42.786838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760c9d7-0ccc-4d79-a548-7c3cb00c91bf None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:42.823515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537331f-26eb-4003-865e-96d7c0c86653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:42.824554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537331f-26eb-4003-865e-96d7c0c86653 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:42.824836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537331f-26eb-4003-865e-96d7c0c86653 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:42.825105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537331f-26eb-4003-865e-96d7c0c86653 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:42.825854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537331f-26eb-4003-865e-96d7c0c86653 None admin] RBAC: Adding query filter params (interface=public, service_id=3608b0401e024d2481c0424b0849e8b3, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:42.826161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537331f-26eb-4003-865e-96d7c0c86653 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:42.827637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537331f-26eb-4003-865e-96d7c0c86653 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:42.833162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 378/779] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 07:58:42 2022] GET /identity/v3/endpoints?service_id=3608b0401e024d2481c0424b0849e8b3&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:42.838588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:42.967670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a83cd-60a0-443a-98eb-fe3c7565f640 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:43.014531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad066e1f-9da0-40a1-a055-b35b81358816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:43.015136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad066e1f-9da0-40a1-a055-b35b81358816 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:43.015423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad066e1f-9da0-40a1-a055-b35b81358816 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:43.015693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad066e1f-9da0-40a1-a055-b35b81358816 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:43.016287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad066e1f-9da0-40a1-a055-b35b81358816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:43.017635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad066e1f-9da0-40a1-a055-b35b81358816 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:43.023567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 402/780] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:58:42 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:43.376561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0c07-2295-43b8-969a-ef9a4d0fca93 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:43.376561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0c07-2295-43b8-969a-ef9a4d0fca93 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:43.376561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0c07-2295-43b8-969a-ef9a4d0fca93 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:43.377638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 379/781] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:43.383300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127532d3-a631-42f2-833e-5fe7154b324e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:43.384135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127532d3-a631-42f2-833e-5fe7154b324e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:43.384636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127532d3-a631-42f2-833e-5fe7154b324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:43.409139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-127532d3-a631-42f2-833e-5fe7154b324e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:43.410675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-127532d3-a631-42f2-833e-5fe7154b324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:43.436810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:43.502178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 403/782] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:43.550116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0c07-2295-43b8-969a-ef9a4d0fca93 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:43.564660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:43.677110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0c07-2295-43b8-969a-ef9a4d0fca93 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:43.723090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fe23e-bc10-4986-b24a-7eafd411e762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:43.723767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fe23e-bc10-4986-b24a-7eafd411e762 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:43.724046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fe23e-bc10-4986-b24a-7eafd411e762 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:43.724320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fe23e-bc10-4986-b24a-7eafd411e762 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:43.737285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fe23e-bc10-4986-b24a-7eafd411e762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-da9fe23e-bc10-4986-b24a-7eafd411e762 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:43.741963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:43.742926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:43.743839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 380/783] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:43.749823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127532d3-a631-42f2-833e-5fe7154b324e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:43.867620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127532d3-a631-42f2-833e-5fe7154b324e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:43.908992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:43.909672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:43.909951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:43.910221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:43.910887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:43.911187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:43.912584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:43.917299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e6ff-3f9f-4a18-81c6-f2138f4a973d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:43.918195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e6ff-3f9f-4a18-81c6-f2138f4a973d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:43.918475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e6ff-3f9f-4a18-81c6-f2138f4a973d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:43.919980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 381/784] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:43.922617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 404/785] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:43.925578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539cfd-cfc5-402d-9aec-6c3f5ca5758e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:43.925904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539cfd-cfc5-402d-9aec-6c3f5ca5758e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:43.926121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539cfd-cfc5-402d-9aec-6c3f5ca5758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:43.927985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:43.945630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d0539cfd-cfc5-402d-9aec-6c3f5ca5758e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:43.946814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d0539cfd-cfc5-402d-9aec-6c3f5ca5758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:43.948235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:44.064894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:44.075452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c9ea-d68c-42ab-9ec5-8da0bf0cae13 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:44.076237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 382/786] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:44.098742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0539cfd-cfc5-402d-9aec-6c3f5ca5758e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.139230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:44.139802 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.140301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.140572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.156520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:44.158079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:44.185541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:44.186545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:44.187484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:44.187484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:44.187484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:44.187484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 405/787] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:44.192369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.284029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0539cfd-cfc5-402d-9aec-6c3f5ca5758e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:44.319765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:44.362699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:44.363376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.363831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.364102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.376905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c670d-cd76-49a5-8842-a327de37547c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:44.388039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:44.393297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:44.394274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:44.395133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 383/788] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:44.403427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.439911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90c783-e8ae-4ddf-8853-23a7966c96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:44.440551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c783-e8ae-4ddf-8853-23a7966c96a5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.440801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c783-e8ae-4ddf-8853-23a7966c96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.441078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c783-e8ae-4ddf-8853-23a7966c96a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.441723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90c783-e8ae-4ddf-8853-23a7966c96a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:44.442030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90c783-e8ae-4ddf-8853-23a7966c96a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:44.443390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90c783-e8ae-4ddf-8853-23a7966c96a5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:44.461309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 406/789] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:44.463207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ec4f-a197-43ec-a071-64bdf12e4b4b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.463519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ec4f-a197-43ec-a071-64bdf12e4b4b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.463804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ec4f-a197-43ec-a071-64bdf12e4b4b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.467542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 407/790] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:44.468584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878ec4f-a197-43ec-a071-64bdf12e4b4b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.496095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:44.555332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bab005-0f5a-4f14-a908-14a019483bec None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:44.590838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878ec4f-a197-43ec-a071-64bdf12e4b4b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:44.602701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff92c0-e007-43b1-8e03-917e53ecc59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:44.603373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff92c0-e007-43b1-8e03-917e53ecc59d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.603825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff92c0-e007-43b1-8e03-917e53ecc59d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.604142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff92c0-e007-43b1-8e03-917e53ecc59d None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.605571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff92c0-e007-43b1-8e03-917e53ecc59d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:44.605684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff92c0-e007-43b1-8e03-917e53ecc59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:44.607332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff92c0-e007-43b1-8e03-917e53ecc59d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:44.621286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 384/791] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:44.622792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86acdb-9268-4492-8df6-2ed1c4c377ad None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.623078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86acdb-9268-4492-8df6-2ed1c4c377ad None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.623351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86acdb-9268-4492-8df6-2ed1c4c377ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.627713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:44.639131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:44.640118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.640605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.641203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.642052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ff86acdb-9268-4492-8df6-2ed1c4c377ad None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:44.643247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ff86acdb-9268-4492-8df6-2ed1c4c377ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:44.650462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:44.652635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:44.669158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:44.670181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:44.671154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:44.678928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 408/792] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:44.678928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.727521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 385/793] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:44.728715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86acdb-9268-4492-8df6-2ed1c4c377ad None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.792943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72421d2-720a-4438-af5d-7642807f2423 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:44.802563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:44.833521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:44.834550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.834972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.835388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.847803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:44.849560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:44.853333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86acdb-9268-4492-8df6-2ed1c4c377ad None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:44.865968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:44.867013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:44.868178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:44.868178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:44.868178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:44.870278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 409/794] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:44.875950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.890889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:44.891641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:44.891988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:44.892328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:44.893127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:44.893502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:44.895118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:44.919111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 386/795] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:44.920079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:44.925628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:44.994912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a119b-3a47-416f-8c98-4d080c56f534 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.029373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648901dc-dd65-4f34-8a4d-a7ed8b1aa940 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.033596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.034474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.034929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.035370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.043063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.050227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:45.056337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:45.057309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:45.058659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 410/796] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:45.059361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.073346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203e070-d563-4f8b-a9f7-38f19dd007aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.074015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203e070-d563-4f8b-a9f7-38f19dd007aa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.074289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203e070-d563-4f8b-a9f7-38f19dd007aa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.074731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203e070-d563-4f8b-a9f7-38f19dd007aa None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.075373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203e070-d563-4f8b-a9f7-38f19dd007aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:45.075749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203e070-d563-4f8b-a9f7-38f19dd007aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.077150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203e070-d563-4f8b-a9f7-38f19dd007aa None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.093283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 387/797] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:45.093283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc103-7754-46d0-a8b8-73b7c00d4b99 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.093283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc103-7754-46d0-a8b8-73b7c00d4b99 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.093283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc103-7754-46d0-a8b8-73b7c00d4b99 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.095547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 388/798] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:45.096796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc103-7754-46d0-a8b8-73b7c00d4b99 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.158783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.163011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cea1ce-9d53-423e-8038-8cc9f2d4191d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.200716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.201261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.201627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.201817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.207681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc103-7754-46d0-a8b8-73b7c00d4b99 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.213503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.216092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:45.231737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:45.232682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:45.233589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:45.233589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:45.233589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:45.233589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 411/799] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:45.233589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.250150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184face-68e0-4938-82ba-d29cc9a72414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.250764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184face-68e0-4938-82ba-d29cc9a72414 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.251042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184face-68e0-4938-82ba-d29cc9a72414 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.251309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184face-68e0-4938-82ba-d29cc9a72414 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.251995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184face-68e0-4938-82ba-d29cc9a72414 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:45.252297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184face-68e0-4938-82ba-d29cc9a72414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.253648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184face-68e0-4938-82ba-d29cc9a72414 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.262696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 389/800] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:45.263751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012f9c-7192-43bb-a676-48e605eb5d0e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.264030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012f9c-7192-43bb-a676-48e605eb5d0e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.264302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012f9c-7192-43bb-a676-48e605eb5d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.281960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4a012f9c-7192-43bb-a676-48e605eb5d0e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:45.283157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4a012f9c-7192-43bb-a676-48e605eb5d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:45.316438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.357475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98d01a-7a8f-4487-8688-05e2b92b369d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.363015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 390/801] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:45.363951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a012f9c-7192-43bb-a676-48e605eb5d0e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.394547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.395178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.395595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.395868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.404132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.405702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:45.417907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:45.418974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 412/802] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:45.423124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.442720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.482571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a012f9c-7192-43bb-a676-48e605eb5d0e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.515991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.516594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.516869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.517136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.517769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:45.518066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.519441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.525669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f205e2-e816-433f-989c-8be9ec494b48 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.530335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 391/803] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:45.531179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.555036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.563347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.563996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.564267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.564539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.575264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.576825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:45.591117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:45.592294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:45.593211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:45.593211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:45.593211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:45.593211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 413/804] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:45.593211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.639099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273007e-ff98-430f-a5a6-a909adab4085 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.661078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.678529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f670436-0b3d-461b-8293-41f713bfd6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.679563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670436-0b3d-461b-8293-41f713bfd6aa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.679847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670436-0b3d-461b-8293-41f713bfd6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.680147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670436-0b3d-461b-8293-41f713bfd6aa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.680729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f670436-0b3d-461b-8293-41f713bfd6aa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.682102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f670436-0b3d-461b-8293-41f713bfd6aa None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-2f670436-0b3d-461b-8293-41f713bfd6aa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:45.691321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:45.697333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:45.698472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 392/805] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:45.699485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d35f0-cb25-4522-a483-75d0b0c2b69f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.699485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d35f0-cb25-4522-a483-75d0b0c2b69f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.699485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d35f0-cb25-4522-a483-75d0b0c2b69f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.699485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 393/806] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:45.699485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d35f0-cb25-4522-a483-75d0b0c2b69f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.704563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253b5b3-1ff8-4a6a-b351-9aeefdea4924 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.738440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847b481-d969-4971-b709-b99247511a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.738942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847b481-d969-4971-b709-b99247511a09 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.739214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847b481-d969-4971-b709-b99247511a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.739539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847b481-d969-4971-b709-b99247511a09 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.740265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847b481-d969-4971-b709-b99247511a09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:45.740562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847b481-d969-4971-b709-b99247511a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.741968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847b481-d969-4971-b709-b99247511a09 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.760460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 414/807] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:45.761914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847b481-d969-4971-b709-b99247511a09 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.795324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.812727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d35f0-cb25-4522-a483-75d0b0c2b69f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.846482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.847107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.847387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.847710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.854274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.856109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.859737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847b481-d969-4971-b709-b99247511a09 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:45.867694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:45.868722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 394/808] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:45.875182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:45.882813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:45.894991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb33da-7a58-4311-9d73-1357ac6f5004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:45.895602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb33da-7a58-4311-9d73-1357ac6f5004 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.895880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb33da-7a58-4311-9d73-1357ac6f5004 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.896140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb33da-7a58-4311-9d73-1357ac6f5004 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.896778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb33da-7a58-4311-9d73-1357ac6f5004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:45.897074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb33da-7a58-4311-9d73-1357ac6f5004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:45.898413 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb33da-7a58-4311-9d73-1357ac6f5004 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:45.909538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 415/809] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:45.910681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30641b-7b87-4f26-a0f0-6384365b446b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:45.910958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30641b-7b87-4f26-a0f0-6384365b446b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:45.911228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30641b-7b87-4f26-a0f0-6384365b446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:45.929938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2e30641b-7b87-4f26-a0f0-6384365b446b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:45.931128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2e30641b-7b87-4f26-a0f0-6384365b446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:45.974438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e679c6-4b1e-410d-813d-ff654e28a42d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:45.999967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 416/810] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:46.000916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30641b-7b87-4f26-a0f0-6384365b446b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.008321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.009180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.009461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.009733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.010765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:46.011933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.013599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.022346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 395/811] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:46.022346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.034258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.108858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30641b-7b87-4f26-a0f0-6384365b446b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.122320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.123435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6096aac-6405-45d1-8d85-4ada1de2eb7e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.143491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.144348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.144623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.144892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.156387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.156978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.157255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.157524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.158205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:46.158505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.159964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.173031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 396/812] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:46.173823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.218390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.219872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.242884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.275088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec762-7c0f-4b2d-b88e-ea8e6579b485 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.312859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.313487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.313763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.314032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.318578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 417/813] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:58:46.319535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.321064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.322493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:46.334272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:46.340283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:46.341526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:46.342207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.342315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 397/814] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:46.342315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.420531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c6ee-6a0d-4537-a0b3-d7ee01adf5cf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.437375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5839-ed34-4686-b081-659d369ea5cd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.453765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.454385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.454660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.454928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] PATH_INFO: `/v3/services/network` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.455527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.456885 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.464871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:46.466441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:46.467491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:46.468587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 418/815] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:46.470084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.475597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.476204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.476482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.476754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.477385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:46.477690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.479054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.484633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 398/816] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:46.485408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.550010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.574337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42daa-6920-42f8-8d33-63fe0bbc2323 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.586433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c56e16-08a7-478f-81da-582038856d6c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.608598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.609286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.609563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.609834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/3a5c88198c71414e99118fe595ad002c/roles/13b0eb7c0ad04dba9ae829944539f1f6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.620239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.620861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.621133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.621405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.624115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=3a5c88198c71414e99118fe595ad002c, role_id=13b0eb7c0ad04dba9ae829944539f1f6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.625550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.632356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.634048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.638228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 419/817] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:46 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/3a5c88198c71414e99118fe595ad002c/roles/13b0eb7c0ad04dba9ae829944539f1f6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:46.639024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:46.649464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:46.650621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:46.652252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:46.652252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:46.652252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:46.652252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 399/818] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:46.652252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.708327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.752703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46138247-2f43-453b-a300-32452d9e3b81 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.775254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1942-0a66-4688-af32-060602273d54 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.781063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.795791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.796946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.796946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.796946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.798454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:46.798454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.800714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.820534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 420/819] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:46.821803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.822270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.822659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.822979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.823342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.824640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:46.825040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.827571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.832938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 400/820] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:46.835017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.926106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c5db-dc97-476d-b72f-38a270237275 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.946422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617266f1-db90-4ce2-a5ab-bab797596cf1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:46.958452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:46.963816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.965384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.965666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.965929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.966578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.968036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:46.989019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:46.989950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:46.990412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:46.990685 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 421/821] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:58:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:46.991082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:46.991639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:46.992242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:46.992745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:46.994600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.015791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 401/822] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:47.015791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.073036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:47.141341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f48ec-078f-48ec-b3e6-991c4f29d1b0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.147095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd04188-da89-4c9c-8b2d-d7c06bd46a52 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.186250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.186870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.187133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.187403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.188081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] RBAC: Adding query filter params (type=network) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:47.188378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.188819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.189627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.189754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.190149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.190557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.196546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 402/823] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:58:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:47.197336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.205833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.207516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:47.224641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:47.225836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:47.226937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:47.226937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:47.226937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:47.230166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 422/824] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:47.230166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.248870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:47.336078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09fcf2-4291-488b-a87a-dba49be0549f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.336660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:47.352118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e420a-5d22-402e-942b-4c201be1ea96 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.382402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.383278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.383751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.384163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.391516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.391682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.392464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.392841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.393272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.393802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.394127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.395936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:47.406477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:47.407531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:47.408633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:47.410424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 403/825] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:47.411389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.435571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 423/826] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:58:47 2022] POST /identity/v3/endpoints => generated 337 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:47.437315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.534580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:47.544958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beda90-0d5b-4b73-81cb-8a6933285091 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.606283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.606791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.607062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.607326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.608901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:47.609198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.610619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.641159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 404/827] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:47.646284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.669906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43457ed-1fae-4d93-be9b-f47d19a2c4de None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.709261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.709877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.710155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.710426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.711182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:47.711511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.712993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.728116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 424/828] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:47.735101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.739727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:47.779373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb973469-08e4-4b58-b37c-8f7dbe3be0b7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.819855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.820898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.821400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.821864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.829801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.831671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:47.843998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:47.844938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:47.845835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:47.848352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 405/829] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:47.859233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:47.875064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20fe1c-3b6c-40ea-9cd9-a5186f6f03bb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:47.879783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:47.933990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:47.935095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:47.936765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:47.937164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:47.938086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=b4e95079af6b4768bc38709a8bdc27bf) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:47.938752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:47.940796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:47.951548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 425/830] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:47 2022] GET /identity/v3/role_assignments?user.id=b4e95079af6b4768bc38709a8bdc27bf&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:47.995299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bbf8-9341-438d-805a-7a685331467d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:48.032178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5043806-59d1-44ee-b907-5cc49b4ad421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:48.032851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043806-59d1-44ee-b907-5cc49b4ad421 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:48.033135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043806-59d1-44ee-b907-5cc49b4ad421 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:48.033411 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043806-59d1-44ee-b907-5cc49b4ad421 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:48.034115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5043806-59d1-44ee-b907-5cc49b4ad421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:48.034420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5043806-59d1-44ee-b907-5cc49b4ad421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:48.035910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5043806-59d1-44ee-b907-5cc49b4ad421 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:48.050243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 406/831] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:48.056265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:48.134405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:48.172934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d23950-3323-4532-b5e7-690de64b3bc1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:48.210363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeec55-b1f8-4282-a60f-53ab7e8d4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:48.211443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeec55-b1f8-4282-a60f-53ab7e8d4c7e None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:48.211741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeec55-b1f8-4282-a60f-53ab7e8d4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:48.212014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeec55-b1f8-4282-a60f-53ab7e8d4c7e None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/666116325de04177accd2bfece858554/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:48.213972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeec55-b1f8-4282-a60f-53ab7e8d4c7e None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=666116325de04177accd2bfece858554, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:48.216294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeec55-b1f8-4282-a60f-53ab7e8d4c7e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:48.233651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 426/832] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:58:48 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/666116325de04177accd2bfece858554/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:58:48.759856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb26f-49d5-48e2-b6fe-2bf1a31a5020 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:48.760384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb26f-49d5-48e2-b6fe-2bf1a31a5020 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:48.760384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb26f-49d5-48e2-b6fe-2bf1a31a5020 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:48.762045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 407/833] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:48.767130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c98e2-3fc0-47b5-b1a0-137ff2a35af2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:48.767581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c98e2-3fc0-47b5-b1a0-137ff2a35af2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:48.767752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c98e2-3fc0-47b5-b1a0-137ff2a35af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:48.786727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cf4c98e2-3fc0-47b5-b1a0-137ff2a35af2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:48.788127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cf4c98e2-3fc0-47b5-b1a0-137ff2a35af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:48.858387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 427/834] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:48.880831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bb26f-49d5-48e2-b6fe-2bf1a31a5020 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:48.959183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:48.993739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bb26f-49d5-48e2-b6fe-2bf1a31a5020 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.030125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdb639-e320-4c85-9611-c448671bf69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.030900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdb639-e320-4c85-9611-c448671bf69a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.031175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdb639-e320-4c85-9611-c448671bf69a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.031516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdb639-e320-4c85-9611-c448671bf69a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.043638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdb639-e320-4c85-9611-c448671bf69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0bbdb639-e320-4c85-9611-c448671bf69a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:49.048418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:49.049349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:49.050201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 408/835] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 07:58:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:49.057611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c98e2-3fc0-47b5-b1a0-137ff2a35af2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.117986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:49.163198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c98e2-3fc0-47b5-b1a0-137ff2a35af2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.193672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffbe6-4628-4a8a-bf63-9ea8c149cd6d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.193999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffbe6-4628-4a8a-bf63-9ea8c149cd6d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.194214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffbe6-4628-4a8a-bf63-9ea8c149cd6d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.195833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 409/836] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:49.199536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.200264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.200539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.200806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.201236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d640-2192-4213-a6d5-78f51af55e2e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.201515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d640-2192-4213-a6d5-78f51af55e2e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.201683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:49.201846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d640-2192-4213-a6d5-78f51af55e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.201995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.203150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:49.213115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 428/837] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:49.219878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.225435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9605d640-2192-4213-a6d5-78f51af55e2e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:49.228596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9605d640-2192-4213-a6d5-78f51af55e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:49.332025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 410/838] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:58:49.345777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672ff1c-90b7-4613-950e-2e02a7d5187f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.353388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605d640-2192-4213-a6d5-78f51af55e2e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.371815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:49.387072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.387900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.388272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.388658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.400179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.402363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:49.419871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:49.420938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:49.421852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:49.421852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:49.421852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:49.425942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 429/839] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:49.427180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.428443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:49.481284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605d640-2192-4213-a6d5-78f51af55e2e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.518816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.519513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.519893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.520263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.521061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.522535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:49.532814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:49.534095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:49.535278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:49.537155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 411/840] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:49.543208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.553180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948b08-2fb6-465c-b79d-21bd07621b44 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.589802 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.590364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.590638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.590912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.591579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:49.591876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.593287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:49.611657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 430/841] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:49.613150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.646408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:49.681392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dbd22-37a4-4a6d-9705-f0d0b99c93ca None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.708444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:49.723971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.725278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.725769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.726224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.727078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:49.728139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.730636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:49.738557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 412/842] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:49.741085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690bf3d-7e3f-4997-b5fc-3ecab1afda90 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.743878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.782186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.782753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.783063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.783340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.791158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.793398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:49.809026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:49.810040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:49.811012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:49.814960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 431/843] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:49.815865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:49.877445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ad157-fc26-462d-a35d-9b2e7fca864f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.918174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.918825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.919107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.919372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.920128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:49.920423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.922021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:49.931846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 413/844] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:49.939446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:49.951185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46fbab-9c23-4814-a3dd-8048c33a8e33 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:49.991538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba9a3-755b-45f0-87dc-232a417a9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:49.992575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba9a3-755b-45f0-87dc-232a417a9e7d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:49.993059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba9a3-755b-45f0-87dc-232a417a9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:49.993536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba9a3-755b-45f0-87dc-232a417a9e7d None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:49.994486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ba9a3-755b-45f0-87dc-232a417a9e7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:49.994999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ba9a3-755b-45f0-87dc-232a417a9e7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:49.997317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ba9a3-755b-45f0-87dc-232a417a9e7d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:50.018984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 432/845] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 07:58:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:50.024613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.087538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:50.141630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068515-e423-4aee-bf26-984dd3cb19be None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:50.179024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62fa5-8c5e-4b3b-b479-a5f6d00549fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:50.180052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62fa5-8c5e-4b3b-b479-a5f6d00549fd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.180625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62fa5-8c5e-4b3b-b479-a5f6d00549fd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.181129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62fa5-8c5e-4b3b-b479-a5f6d00549fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.182226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dd1ab-166d-4148-91ac-0240717cd16b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.182768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dd1ab-166d-4148-91ac-0240717cd16b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.183241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dd1ab-166d-4148-91ac-0240717cd16b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.184901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 433/846] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:50.190001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c70b9-2959-4a0f-bb3a-39354e06c310 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.190282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c70b9-2959-4a0f-bb3a-39354e06c310 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.190553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c70b9-2959-4a0f-bb3a-39354e06c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.208940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-506c70b9-2959-4a0f-bb3a-39354e06c310 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:50.210133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-506c70b9-2959-4a0f-bb3a-39354e06c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:50.274033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62fa5-8c5e-4b3b-b479-a5f6d00549fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:50.276424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62fa5-8c5e-4b3b-b479-a5f6d00549fd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:50.295683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 434/847] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:50.312802 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c70b9-2959-4a0f-bb3a-39354e06c310 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.348021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:50.407318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:50.413705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 414/848] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:58:50.413705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb2c7-cd01-4824-997b-6b1275946857 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.413705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb2c7-cd01-4824-997b-6b1275946857 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.413705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb2c7-cd01-4824-997b-6b1275946857 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.413705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 415/849] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:50.417015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cb2c7-cd01-4824-997b-6b1275946857 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.438172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c70b9-2959-4a0f-bb3a-39354e06c310 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:50.477876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787561-25cb-4a64-9a55-34d8d2c2c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:50.478808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787561-25cb-4a64-9a55-34d8d2c2c197 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.479268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787561-25cb-4a64-9a55-34d8d2c2c197 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.480385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787561-25cb-4a64-9a55-34d8d2c2c197 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.481004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787561-25cb-4a64-9a55-34d8d2c2c197 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:50.482375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787561-25cb-4a64-9a55-34d8d2c2c197 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-41787561-25cb-4a64-9a55-34d8d2c2c197 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:50.491332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:50.492281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:50.493185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 435/850] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:50.493984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c456b7e-4d43-418f-aeb6-4bc55e0e3e6e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.494737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c456b7e-4d43-418f-aeb6-4bc55e0e3e6e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.494737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c456b7e-4d43-418f-aeb6-4bc55e0e3e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.514261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3c456b7e-4d43-418f-aeb6-4bc55e0e3e6e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:50.515501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3c456b7e-4d43-418f-aeb6-4bc55e0e3e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:50.536064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cb2c7-cd01-4824-997b-6b1275946857 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:50.571173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:50.572066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.572343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.572615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.583280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:50.584751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:50.594195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 436/851] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:50.595198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c456b7e-4d43-418f-aeb6-4bc55e0e3e6e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:50.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:50.606642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:50.607598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:50.607598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:50.607598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:50.611404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 416/852] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:50.612323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.616838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:50.692583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:50.724692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153c3b7-8672-4c34-8bc0-ecb43d751f3f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:50.731893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c456b7e-4d43-418f-aeb6-4bc55e0e3e6e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:50.763598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:50.764267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.764546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.764816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.765534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:50.765833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:50.767201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:50.778669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:50.779327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.779721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.779973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 417/853] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:50.784667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.785120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.785229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:50.785229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:50.785229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:50.790119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 437/854] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:50.794796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.853679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:50.895260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9912b-3ded-418c-884f-b527fa24d3e1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:50.902296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de24d-a952-462d-8d97-bb60467205ca None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:50.931957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:50.932931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.933224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.933521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.938887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:50.939539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:50.939820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:50.940094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:50.944169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:50.946788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:50.948237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:50.948898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:50.949827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:50.950679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 418/855] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:50.951369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:50.952397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:50.965951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:50.966909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 438/856] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:50.968265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:51.071219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e521c20-5719-43a6-83c8-0c78bb3ad473 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.078249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b815b5-d9a0-4727-8106-9fccd0fa1171 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.097627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:51.110065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.110676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.110953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.111219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.111977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:51.112271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.113650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.117765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.118365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.118639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.118903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.119596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:51.119892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.121824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.126189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 419/857] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:51.127011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:51.135790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 439/858] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:51.139652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:51.225577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:51.262174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d6be9-1571-4255-8d24-ae191a0de7a4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.278200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fc516-1281-40a6-8e0b-7e05a8ea0899 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.317110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.317719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.317988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.318252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.318934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:51.319230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.320728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.330682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.331645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.332130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.332626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.338868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 420/859] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:51.341238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:51.350988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.352753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:51.372559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:51.373554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:51.374472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:51.374472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:51.374472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:51.380869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 440/860] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:51.382334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:51.400422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:51.464726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c644-e380-4a72-ab89-f9f1557ddf97 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.505468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813d914-b159-4ef4-b1e7-07a2b1337219 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.508402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.509304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.509806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.510284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.511794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=3a5c88198c71414e99118fe595ad002c) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:51.512344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.514029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.520100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:51.525904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 421/861] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:51 2022] GET /identity/v3/role_assignments?user.id=3a5c88198c71414e99118fe595ad002c&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:51.546420 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.547036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.547308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.547606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.548258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:51.548553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.549937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.565014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 441/862] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:51.570716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:51.685360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457514a-f9e2-463a-9e81-9f50f3a5daf5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.699693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:51.731754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.732736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.733213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.733725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.741862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.743561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:51.755556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:51.756519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 07:58:51.757485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:51.758511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 422/863] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:58:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:51.764259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:51.881799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb5058-5a8b-4232-84e5-7dfd5364059a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:51.919318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142775-7047-45e1-8f66-5bb14f198f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:51.920314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142775-7047-45e1-8f66-5bb14f198f09 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:51.920821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142775-7047-45e1-8f66-5bb14f198f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:51.921305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142775-7047-45e1-8f66-5bb14f198f09 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:51.922224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142775-7047-45e1-8f66-5bb14f198f09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:51.922741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142775-7047-45e1-8f66-5bb14f198f09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:51.924365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142775-7047-45e1-8f66-5bb14f198f09 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:51.943453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 442/864] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 07:58:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:51.949420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:52.056568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ddb5f-52b8-4b72-9e5f-fe58b81cc45f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:52.056917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ddb5f-52b8-4b72-9e5f-fe58b81cc45f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:52.057579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ddb5f-52b8-4b72-9e5f-fe58b81cc45f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:52.063588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 443/865] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:52.065191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbfe1-4856-4689-8752-ea1f3d36af5e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:52.065462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbfe1-4856-4689-8752-ea1f3d36af5e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:52.065732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbfe1-4856-4689-8752-ea1f3d36af5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:52.085234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d938fa7-1832-4280-a29b-f065038bd187 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:52.086273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d91cbfe1-4856-4689-8752-ea1f3d36af5e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:52.087470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d91cbfe1-4856-4689-8752-ea1f3d36af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:52.115301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:52.132803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:52.133762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:52.134257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:52.134743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:52.164719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 444/866] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:52.188056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cbfe1-4856-4689-8752-ea1f3d36af5e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:52.225629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:52.227481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:52.263766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:52.310632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cbfe1-4856-4689-8752-ea1f3d36af5e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:52.348219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 423/867] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:58:52.350871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:52.359452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:52.359452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:52.359452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:52.359452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:52.359797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:52.359898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:52.375445 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 445/868] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:58:52 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:58:52.454602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:52.489853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880750-5931-48ee-b1cf-f79abf415c1e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:52.534707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:52.535330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:52.535671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:52.535947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:52.546553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:52.548080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:52.563716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:52.564650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:52.565554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:52.565554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:52.565554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:52.565554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 424/869] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:52.571632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:52.599822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:52.676276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8a83-0c0a-4d7a-ab3e-e9d285095c57 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:52.712792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:52.713403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:52.713677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:52.713980 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:52.714621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:52.714919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:52.716314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:52.728441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 446/870] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:52.734157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:52.843432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77107-ae92-47f3-8759-2a40612a83f9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:52.865541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:52.880300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:52.881390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:52.882032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:52.882540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:52.890734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:52.892257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:52.904553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:52.905496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:52.906383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 425/871] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:52.913330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:53.000110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:53.019668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49f76c-99b1-40a4-9789-62b6a1d324ed None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:53.054737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745d4df-7a8e-48af-9acb-1672280c75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:53.055344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d4df-7a8e-48af-9acb-1672280c75b2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:53.055649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d4df-7a8e-48af-9acb-1672280c75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:53.055974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d4df-7a8e-48af-9acb-1672280c75b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:53.056662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745d4df-7a8e-48af-9acb-1672280c75b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:53.056963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745d4df-7a8e-48af-9acb-1672280c75b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:53.058848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745d4df-7a8e-48af-9acb-1672280c75b2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:53.070889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 447/872] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:53.077209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:53.181087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c5de-d96f-4928-bcc1-eebf125c5058 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:53.218042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df643-64f8-4121-83b1-90565231c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:53.219003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df643-64f8-4121-83b1-90565231c61f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:53.219498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df643-64f8-4121-83b1-90565231c61f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:53.219968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df643-64f8-4121-83b1-90565231c61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:53.220902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3df643-64f8-4121-83b1-90565231c61f None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=666116325de04177accd2bfece858554) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:53.221403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3df643-64f8-4121-83b1-90565231c61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:53.223025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3df643-64f8-4121-83b1-90565231c61f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:53.229786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 426/873] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:53 2022] GET /identity/v3/role_assignments?user.id=666116325de04177accd2bfece858554&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:53.281173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285598-764e-4666-b533-01481001b825 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:53.281473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285598-764e-4666-b533-01481001b825 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:53.281722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285598-764e-4666-b533-01481001b825 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:53.283542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 448/874] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:53.289262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7d11-5085-4514-9770-cc552acdf555 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:53.289881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7d11-5085-4514-9770-cc552acdf555 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:53.290379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7d11-5085-4514-9770-cc552acdf555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:53.311170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4eec7d11-5085-4514-9770-cc552acdf555 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:53.312752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4eec7d11-5085-4514-9770-cc552acdf555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:53.358116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:53.389416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 427/875] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:53.414061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285598-764e-4666-b533-01481001b825 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:53.522864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285598-764e-4666-b533-01481001b825 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:53.559907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8ed28-4cef-4b75-9d13-24c125c4a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:53.560860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ed28-4cef-4b75-9d13-24c125c4a777 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:53.561333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ed28-4cef-4b75-9d13-24c125c4a777 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:53.561822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ed28-4cef-4b75-9d13-24c125c4a777 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:53.562650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8ed28-4cef-4b75-9d13-24c125c4a777 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:53.564230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8ed28-4cef-4b75-9d13-24c125c4a777 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:53.575640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:53.581955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 449/876] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:58:53 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:53.775947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d408cbb-5bbd-4869-956a-ec8e71d52e44 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:53.776128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d408cbb-5bbd-4869-956a-ec8e71d52e44 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:53.776467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d408cbb-5bbd-4869-956a-ec8e71d52e44 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:53.778562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 428/877] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:53.783844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5036b-a71d-47d1-b7cd-b31d6a4cf4ae None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:53.784127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5036b-a71d-47d1-b7cd-b31d6a4cf4ae None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:53.784400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5036b-a71d-47d1-b7cd-b31d6a4cf4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:53.803136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fff5036b-a71d-47d1-b7cd-b31d6a4cf4ae None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:53.804347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fff5036b-a71d-47d1-b7cd-b31d6a4cf4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:53.883617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 450/878] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:53.908450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d408cbb-5bbd-4869-956a-ec8e71d52e44 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.020390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d408cbb-5bbd-4869-956a-ec8e71d52e44 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:54.056045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:54.057031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.058399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.059149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.069861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:54.075201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:54.076165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:58:54.077017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:54.080074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 429/879] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 07:58:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:54.088524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5036b-a71d-47d1-b7cd-b31d6a4cf4ae None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.192365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5036b-a71d-47d1-b7cd-b31d6a4cf4ae None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:54.219280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:54.230201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:54.230806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.231078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.231340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.232030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:54.232324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:54.233669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:54.242319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 451/880] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:54.247944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.285043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:54.357205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e60a37-7440-4248-9c2a-83b7d904e275 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:54.392086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caa69a-4342-48b8-a4f7-4885ed07fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:54.392707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa69a-4342-48b8-a4f7-4885ed07fa94 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.392978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa69a-4342-48b8-a4f7-4885ed07fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.393245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa69a-4342-48b8-a4f7-4885ed07fa94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.403876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caa69a-4342-48b8-a4f7-4885ed07fa94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:54.405470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caa69a-4342-48b8-a4f7-4885ed07fa94 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-66caa69a-4342-48b8-a4f7-4885ed07fa94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:54.419984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:54.420958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:54.421870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:54.421870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:54.421870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:54.421870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 430/881] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:54.428484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.539369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5f560-5941-471d-bb14-dfd7d100a9cf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:54.575437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:54.576048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.576322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.576592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.577221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:54.577516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:54.578869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:54.591921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159e99c-953f-45b1-a3a1-9486ee276212 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.592285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159e99c-953f-45b1-a3a1-9486ee276212 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.592421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 452/882] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:54.592567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159e99c-953f-45b1-a3a1-9486ee276212 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.594095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 431/883] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:54.598003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.599700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a15af-2965-4cba-91e2-a8f4b9e76b6d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.599974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a15af-2965-4cba-91e2-a8f4b9e76b6d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.600247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a15af-2965-4cba-91e2-a8f4b9e76b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.618848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2c0a15af-2965-4cba-91e2-a8f4b9e76b6d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:54.620165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2c0a15af-2965-4cba-91e2-a8f4b9e76b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:54.658714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:54.711478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 432/884] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:54.719675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f532a-3c0d-4f17-91aa-6b7b3c052061 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:54.728212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a15af-2965-4cba-91e2-a8f4b9e76b6d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.747641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:54.763318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:54.764185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.764634 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.765051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.773081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:54.774793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:58:54.788358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:54.789368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:58:54.790334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:54.798385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 453/885] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:54.799377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.844423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a15af-2965-4cba-91e2-a8f4b9e76b6d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:54.889073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:54.890422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.890892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.891602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.892332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:54.894674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:54.908687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:54.910108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:54.911227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:54.914457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 433/886] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:54.921626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:54.922687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79792-3090-4f70-9e57-11ec533fd67c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:54.937148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:54.965307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:54.965963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:54.966284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:54.966684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:54.967491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:54.967845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:54.969465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:54.994039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 454/887] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:54.995001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.035874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:55.040506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886b6ab-0b17-4c56-a18c-7888cb77a195 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.086144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.087136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.087445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.087714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.088355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:55.088653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.090784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.098201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 434/888] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:55.103603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.108596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10008a6-9091-4676-b678-df61f11ca91b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.160064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.160760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.161137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.161512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.200475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:55.233922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b1c7-f606-47ec-a856-813b8387c37c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.239660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.241200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.280680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.281292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.281573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.281910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.282602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:55.282906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.284342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.296567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 435/889] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:55.297859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.312303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:55.378344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 455/890] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:58:54 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:58:55.379517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.428268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675778-ae2f-4b1c-9bcc-f9784aadd9f6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.454909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:55.464862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b5eb0-db35-4292-bd4d-34d2e5976ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.465468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5eb0-db35-4292-bd4d-34d2e5976ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.465739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5eb0-db35-4292-bd4d-34d2e5976ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.466003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5eb0-db35-4292-bd4d-34d2e5976ea3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.466696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5eb0-db35-4292-bd4d-34d2e5976ea3 None admin] RBAC: Adding query filter params (interface=public, service_id=fb3277fcf5484a3195369714c0b49b7f, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:55.466994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5eb0-db35-4292-bd4d-34d2e5976ea3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.468391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5eb0-db35-4292-bd4d-34d2e5976ea3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.478222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 436/891] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/endpoints?service_id=fb3277fcf5484a3195369714c0b49b7f&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:55.478222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34540-0184-4a64-8019-2f3601e13664 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.478222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34540-0184-4a64-8019-2f3601e13664 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.478222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34540-0184-4a64-8019-2f3601e13664 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.478222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 437/892] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:55.482130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb34540-0184-4a64-8019-2f3601e13664 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.499767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc451e-8a15-4d04-beb0-bd72e6d1247f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.537098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d36318-7c04-4e85-b0b6-ea3f06a5cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.537732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d36318-7c04-4e85-b0b6-ea3f06a5cac2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.538012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d36318-7c04-4e85-b0b6-ea3f06a5cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.538296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d36318-7c04-4e85-b0b6-ea3f06a5cac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.549181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d36318-7c04-4e85-b0b6-ea3f06a5cac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.550626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d36318-7c04-4e85-b0b6-ea3f06a5cac2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.561386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-38d36318-7c04-4e85-b0b6-ea3f06a5cac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:55.567676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:55.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:55.569622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:55.569622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:55.569622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:55.569622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 456/893] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:55.570406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276654d-cc62-4444-b34e-765498f1953e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.570684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276654d-cc62-4444-b34e-765498f1953e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.570955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276654d-cc62-4444-b34e-765498f1953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.589933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1276654d-cc62-4444-b34e-765498f1953e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:55.591123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1276654d-cc62-4444-b34e-765498f1953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:55.598063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb34540-0184-4a64-8019-2f3601e13664 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.634384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.634986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.635265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.635563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.636844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.638219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.646284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 438/894] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:58:55.647129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.678467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 457/895] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:55.690950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7f09-3a5a-4fa3-8b27-9b5b406be223 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.691282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7f09-3a5a-4fa3-8b27-9b5b406be223 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.691590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7f09-3a5a-4fa3-8b27-9b5b406be223 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.693081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 458/896] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:55.699206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ee59-cddb-45b2-8e35-d617e788605e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.699582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ee59-cddb-45b2-8e35-d617e788605e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.699787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ee59-cddb-45b2-8e35-d617e788605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.719037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9910ee59-cddb-45b2-8e35-d617e788605e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:55.720302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9910ee59-cddb-45b2-8e35-d617e788605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:55.768486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:55.784970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159cf45-15a3-49e8-b0f4-46ea50703f38 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.797130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 459/897] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:58:55.797812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910ee59-cddb-45b2-8e35-d617e788605e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.825991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.826601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.826874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.827141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.827914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:55.828217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.829575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.832160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:55.843392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 439/898] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:55.844254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.911179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910ee59-cddb-45b2-8e35-d617e788605e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.947378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.947950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.948369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.948660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.949238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:55.950589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:55.954885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce93c1-b267-4756-8332-603eedc241b6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:55.959081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:55.960292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:55.961151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 460/899] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:55.961959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:55.998204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:55.998856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:55.999134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:55.999402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:55.999402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.001436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.007225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:56.012541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:56.013487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:56.014416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 440/900] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:56.015214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.071142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12355a-b56b-4073-b50e-5ebcf89fbaa6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.081759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:56.109573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.110197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.110469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.110805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.117468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.118889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.127803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b160-31b3-44cf-bb6d-295e470097d9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:58:56.130750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:56.131743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 461/901] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:56.132676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.177211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.178602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.178880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.179154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.179832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:56.180137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.181505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.191578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 441/902] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:56.192513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.251687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ecd29-1eba-48d6-a7c7-8eba88c1a822 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.253915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:56.287478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.288113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.288619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.288749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.289342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:56.289640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.291103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.301086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 462/903] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:56.301086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.311860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0ea6-9297-4740-b95a-8cd1ea444014 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.336777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:56.351164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.352042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.352534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.352803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.353574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:56.353867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.355388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.373543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 442/904] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:56.373543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.415714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b398fb-5af1-43f8-b147-e2d977811122 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.452017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.452627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.452904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.453180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.453814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:56.454122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.455510 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.459908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 463/905] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:56.460679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.492498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e42fd-bca1-4bc1-ac53-c66ac89faa46 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.507322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:56.544736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.545367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.545643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.545914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.547044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:56.547376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.549284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.556727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 443/906] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:56.563361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.611837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e95a2-1bb4-42d1-a4bd-92b331f1ca03 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.619337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:56.662093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.663274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.664218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.664639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.665748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] RBAC: Adding query filter params (role.id=5514b5ec965047d9ae1f64916f0582a9, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=3a5c88198c71414e99118fe595ad002c) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:56.666470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.669045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.676545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 464/907] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/role_assignments?user.id=3a5c88198c71414e99118fe595ad002c&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=5514b5ec965047d9ae1f64916f0582a9 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:56.686975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217dbab-a4f0-4d09-b6bb-e36753ac4da6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.728042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84f6fd-4d8d-4520-8bf5-e87d3bc49ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.728656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84f6fd-4d8d-4520-8bf5-e87d3bc49ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.728928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84f6fd-4d8d-4520-8bf5-e87d3bc49ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.729194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84f6fd-4d8d-4520-8bf5-e87d3bc49ff0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.730506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84f6fd-4d8d-4520-8bf5-e87d3bc49ff0 None admin] RBAC: Adding query filter params (interface=public, service_id=dde47bed109e40b2b639f535fa0d4530, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:56.730819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84f6fd-4d8d-4520-8bf5-e87d3bc49ff0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.732917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84f6fd-4d8d-4520-8bf5-e87d3bc49ff0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.740270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 444/908] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/endpoints?service_id=dde47bed109e40b2b639f535fa0d4530&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:56.747683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:56.869073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:56.879596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256402f4-bd18-40cb-9b69-cab2e8323352 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:56.922906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adb4aa-5c73-49d3-a05b-e92a53d2e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:56.923741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adb4aa-5c73-49d3-a05b-e92a53d2e03c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:56.924175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adb4aa-5c73-49d3-a05b-e92a53d2e03c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:56.924551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adb4aa-5c73-49d3-a05b-e92a53d2e03c None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:56.925268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adb4aa-5c73-49d3-a05b-e92a53d2e03c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:56.926737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adb4aa-5c73-49d3-a05b-e92a53d2e03c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:56.937381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 465/909] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:58:56 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:58:57.858983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c4c8d-825e-4eed-9643-e673216300a2 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:57.859532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c4c8d-825e-4eed-9643-e673216300a2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:57.859532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c4c8d-825e-4eed-9643-e673216300a2 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:57.861112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 445/910] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:57.866352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503759d-ca12-4fc0-9a60-9ea62bb3f54a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:57.866759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503759d-ca12-4fc0-9a60-9ea62bb3f54a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:57.866902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503759d-ca12-4fc0-9a60-9ea62bb3f54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:57.884663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3503759d-ca12-4fc0-9a60-9ea62bb3f54a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:57.885890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3503759d-ca12-4fc0-9a60-9ea62bb3f54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:57.954700 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 466/911] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:57.978137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c4c8d-825e-4eed-9643-e673216300a2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:58.087812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c4c8d-825e-4eed-9643-e673216300a2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:58.101677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:58.125452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:58.126022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.126454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.126943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.127378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:58.128791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:58.141407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:58.142543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:58.143985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 446/912] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:58.152663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503759d-ca12-4fc0-9a60-9ea62bb3f54a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:58.245285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:58.258430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503759d-ca12-4fc0-9a60-9ea62bb3f54a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:58.298028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:58.298028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.298028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.298028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.298795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:58.298795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:58.298795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:58.303930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 467/913] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:58.310193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:58.415227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dccce-f644-46ef-bf51-a4169c963f73 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:58.450755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfc3c3-737a-4b88-bd01-da48cab5a013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:58.451743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfc3c3-737a-4b88-bd01-da48cab5a013 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.452194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfc3c3-737a-4b88-bd01-da48cab5a013 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.452636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfc3c3-737a-4b88-bd01-da48cab5a013 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.453429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfc3c3-737a-4b88-bd01-da48cab5a013 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:58.453899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfc3c3-737a-4b88-bd01-da48cab5a013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:58.455459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfc3c3-737a-4b88-bd01-da48cab5a013 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:58.464333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 447/914] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 07:58:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:58.467951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:58.571429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a0ddb-8a53-4c62-9ad8-607ca97bff92 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:58.602148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26c59-1bf9-4039-b63f-d998ec78002f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.602905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26c59-1bf9-4039-b63f-d998ec78002f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.603400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26c59-1bf9-4039-b63f-d998ec78002f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.606028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 448/915] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:58.610025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:58.610881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.611095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0760-2dcd-4f3f-9f35-11df3d48542f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.611377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0760-2dcd-4f3f-9f35-11df3d48542f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.611690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0760-2dcd-4f3f-9f35-11df3d48542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.611979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.612435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.613271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:58.615016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:58.630861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2bba0760-2dcd-4f3f-9f35-11df3d48542f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:58.631977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2bba0760-2dcd-4f3f-9f35-11df3d48542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:58.645100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 468/916] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:58:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:58.681681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:58.730630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 449/917] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:58:58.753603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:58.767150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:58.867185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b09d-44e2-4aa6-ac55-b1214be4e81e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:58.904928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162d8ec-9099-47c3-959f-b9d0a1d5c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:58.905537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d8ec-9099-47c3-959f-b9d0a1d5c00a None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.905810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d8ec-9099-47c3-959f-b9d0a1d5c00a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.906080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d8ec-9099-47c3-959f-b9d0a1d5c00a None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.906719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162d8ec-9099-47c3-959f-b9d0a1d5c00a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:58.908096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162d8ec-9099-47c3-959f-b9d0a1d5c00a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:58.925595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 469/918] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:58:58 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:58:58.985231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c5113-5328-4331-af01-7e8816869043 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.985736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c5113-5328-4331-af01-7e8816869043 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.985736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c5113-5328-4331-af01-7e8816869043 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:58.987236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 450/919] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:58:58.993384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e267a5-717a-4d4b-9e5b-99ac73f404e5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:58.994039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e267a5-717a-4d4b-9e5b-99ac73f404e5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:58.994520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e267a5-717a-4d4b-9e5b-99ac73f404e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.016296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-12e267a5-717a-4d4b-9e5b-99ac73f404e5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:59.017896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-12e267a5-717a-4d4b-9e5b-99ac73f404e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:59.091883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:59.103736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 470/920] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:58:59.126073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c5113-5328-4331-af01-7e8816869043 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.157492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163db1c-ce4e-46dc-9065-1ff6dce3fc5a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.157808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163db1c-ce4e-46dc-9065-1ff6dce3fc5a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.158048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163db1c-ce4e-46dc-9065-1ff6dce3fc5a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.159779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 471/921] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:58:59.165185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ff634-dcae-485e-aa58-56a563a0505f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.165569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ff634-dcae-485e-aa58-56a563a0505f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.165942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ff634-dcae-485e-aa58-56a563a0505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.190118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-682ff634-dcae-485e-aa58-56a563a0505f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:58:59.191775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-682ff634-dcae-485e-aa58-56a563a0505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:58:59.249738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c5113-5328-4331-af01-7e8816869043 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:59.287116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:59.287811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.288178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.288545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.295241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 472/922] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:58:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:58:59.313601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:58:59.317749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ff634-dcae-485e-aa58-56a563a0505f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:58:59.319131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:59.320334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:58:59.321420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:59.323768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 451/923] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:58:59.335466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.364319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:59.449265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf3f9-a206-4290-af6d-eab03bcbc1ef None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:59.458206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ff634-dcae-485e-aa58-56a563a0505f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:59.486992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:59.487643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.487924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.488304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.489149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:59.490215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:59.490795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:59.492449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:59.507578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 452/924] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:59.508958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:59.509457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.509635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.509889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.510167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.511375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:59.512905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:59.521997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:59.522965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:58:59.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 473/925] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:59.535548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.613217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:59.628643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d723d-5c2d-4311-afd6-d05900b16967 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:59.664173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270f205-3162-4647-af1e-a51905aac309 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:59.678199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:59.679605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.680298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.680749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.696531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:59.698807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:59.701134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:59.701811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.702312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.702422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.703128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:59.703526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:59.704942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:59.715763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 474/926] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:59.716718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:58:59.716977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:58:59.717879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:58:59.718791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:58:59.718791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:58:59.718791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:58:59.722046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 453/927] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:58:59.728202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.777084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:59.835491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c49f0-7ebf-432c-88cd-86f5a6077c98 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:59.855652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029932-6377-432c-9bc4-a1995a484c3a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:58:59.873899 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:59.874541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.874959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.875388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.876064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:59.876428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:59.877943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:59.887739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 475/928] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:58:59.889587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:58:59.901981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:58:59.903366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:58:59.903985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:58:59.904532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:58:59.905378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:58:59.906007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:58:59.908225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:58:59.919748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:58:59.930321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 454/929] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:58:59.931982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:00.008433 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c45cb-57f8-489f-bb0a-8285e2429a35 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:00.031350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:00.055461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:00.056246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f521b5-f966-467b-bbe1-54b1e89884e5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:00.056974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.057744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.058467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.059931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:00.061289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:00.089298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 476/930] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:58:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:59:00.108228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:00.109341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.109840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.110417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.119848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:00.122021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:59:00.136751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:00.137785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:59:00.138744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:00.141487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 455/931] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 07:58:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:00.147870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:00.268976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80a9ef-ba1c-4387-9328-ee61107c0aeb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:00.311945 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:00.312562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.312835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.313100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.313831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:00.314131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:00.316625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:00.334377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 477/932] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 07:59:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:00.340545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:00.402075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:00.447653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20682b28-04ed-4e08-b1ec-247a7962da01 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:00.483536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:00.484166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.484436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.484701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.495770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:00.497222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:00.512526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:00.513583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:00.514578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:00.514578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:00.514578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:00.514578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 456/933] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:00.519558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:00.551551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:00.635192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f694c-1ce5-4072-80d8-b57cb53942f8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:00.672337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3b5ff-6065-4888-b5bc-9494711ab883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:00.673335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b5ff-6065-4888-b5bc-9494711ab883 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.673814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b5ff-6065-4888-b5bc-9494711ab883 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.674289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b5ff-6065-4888-b5bc-9494711ab883 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.675314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3b5ff-6065-4888-b5bc-9494711ab883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:00.675938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3b5ff-6065-4888-b5bc-9494711ab883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:00.677499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3b5ff-6065-4888-b5bc-9494711ab883 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:00.692494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 478/934] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:00.699466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:00.799215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb057-9249-464b-901b-9281ccd99d47 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.799589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb057-9249-464b-901b-9281ccd99d47 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.799838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb057-9249-464b-901b-9281ccd99d47 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.802351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 479/935] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:00.803858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb2fe-26ab-4be5-9fc2-98dea890d599 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:00.806299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edce3ed-ccbf-4742-ac54-249a074a9267 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.806584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edce3ed-ccbf-4742-ac54-249a074a9267 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.806868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edce3ed-ccbf-4742-ac54-249a074a9267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.814221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:00.827216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4edce3ed-ccbf-4742-ac54-249a074a9267 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:00.828561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4edce3ed-ccbf-4742-ac54-249a074a9267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:00.845051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:00.845924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:00.846204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:00.846851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:00.856087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:00.857693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:59:00.872409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:00.873455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:00.874452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 457/936] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:00.880502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:00.922081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 480/937] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:00.939702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edce3ed-ccbf-4742-ac54-249a074a9267 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:00.964538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:01.003715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a79ff5-f0bf-4fda-8077-d3ededf837f2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.044074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7d6c1-168c-42d3-8cfc-6ece42c0966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.044960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7d6c1-168c-42d3-8cfc-6ece42c0966c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.045240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7d6c1-168c-42d3-8cfc-6ece42c0966c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.045509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7d6c1-168c-42d3-8cfc-6ece42c0966c None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.046195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7d6c1-168c-42d3-8cfc-6ece42c0966c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:01.046495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7d6c1-168c-42d3-8cfc-6ece42c0966c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.047939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7d6c1-168c-42d3-8cfc-6ece42c0966c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.060425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 458/938] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:01.067388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002e43a-ff95-4d62-939e-ac6e0787b70e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.067388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002e43a-ff95-4d62-939e-ac6e0787b70e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.067674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edce3ed-ccbf-4742-ac54-249a074a9267 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.067778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002e43a-ff95-4d62-939e-ac6e0787b70e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.067778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 459/939] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:01.067778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002e43a-ff95-4d62-939e-ac6e0787b70e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:01.098462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:01.103527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.104305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.104533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.104845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.105495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.106922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.109582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING keystone.server.flask.common [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 07:59:01.128008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.sql.core [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 07:59:01.128008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 07:59:01.128008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [parameters: {'id': '7b6482c9e9c24935a33f151217498e28', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 07:59:01.128008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-aa4af102-07f7-4d14-9a45-ac7432777a5d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b6482c9e9c24935a33f151217498e28.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b6482c9e9c24935a33f151217498e28. Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:59:01.144795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 07:59:01.145679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application yield resource Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise self.value Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application session.commit() Aug 10 07:59:01.146689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.flush() Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application compat.raise_( Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 07:59:01.147662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 07:59:01.148586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:59:01.149387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [parameters: {'id': '7b6482c9e9c24935a33f151217498e28', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:01.151811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:01.153206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b6482c9e9c24935a33f151217498e28. Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 481/940] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 10 07:59:00 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145a69a-2d38-4a90-a810-1aa68326395f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.155281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145a69a-2d38-4a90-a810-1aa68326395f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.157051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145a69a-2d38-4a90-a810-1aa68326395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.170411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8145a69a-2d38-4a90-a810-1aa68326395f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:01.172035 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8145a69a-2d38-4a90-a810-1aa68326395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:01.190452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002e43a-ff95-4d62-939e-ac6e0787b70e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.226233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.227008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.227319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.227657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/3a5c88198c71414e99118fe595ad002c/roles/5514b5ec965047d9ae1f64916f0582a9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.230410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=3a5c88198c71414e99118fe595ad002c, role_id=5514b5ec965047d9ae1f64916f0582a9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.232041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.245902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 460/941] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:59:01 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/3a5c88198c71414e99118fe595ad002c/roles/5514b5ec965047d9ae1f64916f0582a9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:59:01.246971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:01.271475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 482/942] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:01.290424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145a69a-2d38-4a90-a810-1aa68326395f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:01.300977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:01.370043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:01.387552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9293c9-dde3-4335-943f-ea822f04f729 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.411471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145a69a-2d38-4a90-a810-1aa68326395f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.431363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.432273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.433131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.433483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.440738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.442104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:59:01.455393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:01.456371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:01.457439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 461/943] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:01.464459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.464631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:01.465541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.465992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.466440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.467615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.470407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:01.483074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:01.484339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:01.485442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:01.488128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 483/944] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:59:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:01.499457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:01.579796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:01.586328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c1bbd-24b7-4f4f-b4f8-176897f3ae67 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.612799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c8509-ea00-4fb5-bea2-e283526af616 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.623599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.624214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.624488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.624759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.625422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:01.625720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.627166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.651765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 462/945] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:59:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:01.655540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.656181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.656469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.656750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.657410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:01.657718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.659146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.672947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 484/946] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:01.674470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:01.687526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:01.793232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb97b0-2810-43bc-904b-6e21cdba50da None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.832431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.833037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.833313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.833583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.834220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:01.834518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:01.835989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:01.842181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 463/947] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:01.848384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:01.958950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55016eee-89e9-4f7a-a31e-59a96f0de2a7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:01.996939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d909a7-70a2-4634-a70c-b9b6ec6f0d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:01.997557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d909a7-70a2-4634-a70c-b9b6ec6f0d1f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:01.997834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d909a7-70a2-4634-a70c-b9b6ec6f0d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:01.998101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d909a7-70a2-4634-a70c-b9b6ec6f0d1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:01.998873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d909a7-70a2-4634-a70c-b9b6ec6f0d1f None admin] RBAC: Adding query filter params (interface=public, service_id=2fc7ca7119db4261b20ea006ca0dc6f7, region_id=RegionOne) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:01.999182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d909a7-70a2-4634-a70c-b9b6ec6f0d1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:02.000580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d909a7-70a2-4634-a70c-b9b6ec6f0d1f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:02.002469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:02.009226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 485/948] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 07:59:01 2022] GET /identity/v3/endpoints?service_id=2fc7ca7119db4261b20ea006ca0dc6f7&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:02.015308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:02.093871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:02.132445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf93cbd-0b55-4937-a9e7-0c2585bb7d12 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:02.171155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c03f80-2417-4295-afd3-0c071c6027a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:02.171788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03f80-2417-4295-afd3-0c071c6027a6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:02.172068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03f80-2417-4295-afd3-0c071c6027a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:02.172342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03f80-2417-4295-afd3-0c071c6027a6 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:02.172941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c03f80-2417-4295-afd3-0c071c6027a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:02.174304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c03f80-2417-4295-afd3-0c071c6027a6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:02.180748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 464/949] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:59:02 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:59:02.303154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf504-f4ed-44fb-bedf-888748a354e1 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:02.303578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf504-f4ed-44fb-bedf-888748a354e1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:02.303750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf504-f4ed-44fb-bedf-888748a354e1 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:02.305302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 486/950] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:02.311690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a064f-6e1d-434c-bfe7-1b9471678bc7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:02.312020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a064f-6e1d-434c-bfe7-1b9471678bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:02.312235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a064f-6e1d-434c-bfe7-1b9471678bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:02.331576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0f9a064f-6e1d-434c-bfe7-1b9471678bc7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:02.332784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0f9a064f-6e1d-434c-bfe7-1b9471678bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:02.406094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 465/951] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:02.427313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdf504-f4ed-44fb-bedf-888748a354e1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:02.536460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdf504-f4ed-44fb-bedf-888748a354e1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:02.572386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:02.573046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:02.573320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:02.573584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:02.574165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:02.575647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:02.584563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:02.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:02.586473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 487/952] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:02.591973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a064f-6e1d-434c-bfe7-1b9471678bc7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:02.661516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:02.699686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a064f-6e1d-434c-bfe7-1b9471678bc7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:02.736221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6ed5a-7368-44fb-904f-4496ed57a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:02.736823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6ed5a-7368-44fb-904f-4496ed57a62f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:02.737096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6ed5a-7368-44fb-904f-4496ed57a62f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:02.737362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6ed5a-7368-44fb-904f-4496ed57a62f None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:02.738047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6ed5a-7368-44fb-904f-4496ed57a62f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:02.738349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6ed5a-7368-44fb-904f-4496ed57a62f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:02.739746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6ed5a-7368-44fb-904f-4496ed57a62f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:02.745461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 466/953] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:59:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:02.751075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:02.816101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:02.856565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161415-bbfb-4a7b-b616-8a34a673a22f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:02.891661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649066c-6789-438d-b442-65858e44cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:02.892272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649066c-6789-438d-b442-65858e44cad2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:02.892547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649066c-6789-438d-b442-65858e44cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:02.892819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649066c-6789-438d-b442-65858e44cad2 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:02.893449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649066c-6789-438d-b442-65858e44cad2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:02.893804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649066c-6789-438d-b442-65858e44cad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:02.895224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649066c-6789-438d-b442-65858e44cad2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:02.900683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 488/954] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:59:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:03.374950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950bb9-3cd0-430c-af92-c86b38f6a31a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:03.375580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950bb9-3cd0-430c-af92-c86b38f6a31a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:03.375580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950bb9-3cd0-430c-af92-c86b38f6a31a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:03.377067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 467/955] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:03.382865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e36b-1339-4406-a45f-d2d200fa14a7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:03.383918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e36b-1339-4406-a45f-d2d200fa14a7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:03.384413 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e36b-1339-4406-a45f-d2d200fa14a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:03.405421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5324e36b-1339-4406-a45f-d2d200fa14a7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:03.407062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5324e36b-1339-4406-a45f-d2d200fa14a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:03.482002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 489/956] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:03.506260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9950bb9-3cd0-430c-af92-c86b38f6a31a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:03.617867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9950bb9-3cd0-430c-af92-c86b38f6a31a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:03.650047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:03.658063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:03.658991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:03.659527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:03.659997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:03.671627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:03.676637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:03.677756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:03.678669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:03.681067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 468/957] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 07:59:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:03.692518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e36b-1339-4406-a45f-d2d200fa14a7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:03.752627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:03.802006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e36b-1339-4406-a45f-d2d200fa14a7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:03.844356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1e64c-660e-4705-9161-8978f3935f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:03.846002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e64c-660e-4705-9161-8978f3935f29 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:03.846619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e64c-660e-4705-9161-8978f3935f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:03.847099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e64c-660e-4705-9161-8978f3935f29 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:03.848017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e64c-660e-4705-9161-8978f3935f29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:03.848528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e64c-660e-4705-9161-8978f3935f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:03.850099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e64c-660e-4705-9161-8978f3935f29 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:03.859723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 490/958] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 07:59:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:03.868805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:03.886921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c697a-50c8-42ce-a878-f29a29d98649 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:03.887572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c697a-50c8-42ce-a878-f29a29d98649 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:03.888072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c697a-50c8-42ce-a878-f29a29d98649 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:03.889882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 491/959] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:03.895140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75d54-f0fb-4b34-90c4-c3e99141ca25 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:03.895702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75d54-f0fb-4b34-90c4-c3e99141ca25 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:03.896199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75d54-f0fb-4b34-90c4-c3e99141ca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:03.914951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-37d75d54-f0fb-4b34-90c4-c3e99141ca25 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:03.916885 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-37d75d54-f0fb-4b34-90c4-c3e99141ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:03.981702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fbf68-a284-49f6-8451-0dc4c646d484 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.015546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 492/960] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:04.025459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.026145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.026809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.027224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.038129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.039707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.041030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d75d54-f0fb-4b34-90c4-c3e99141ca25 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:04.061912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:04.062941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:04.063906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:04.063906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:04.063906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:04.066015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 469/961] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:04.074569 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.107699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:04.137337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:04.173276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d75d54-f0fb-4b34-90c4-c3e99141ca25 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.209955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fee49b-266d-4a68-bc0d-630f16e11863 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.213825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.214745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.215024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.215295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.215973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.217398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.234220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.sql.core [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 07:59:04.234220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 07:59:04.234220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [parameters: {'user_id': '3b7431dc50f74ae3a590caf3cc0c0ad0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 07:59:04.234220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() Aug 10 07:59:04.241431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:59:04.242744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application yield resource Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise self.value Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application session.commit() Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 07:59:04.244027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.flush() Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application compat.raise_( Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 07:59:04.245111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 07:59:04.246261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 07:59:04.247155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [parameters: {'user_id': '3b7431dc50f74ae3a590caf3cc0c0ad0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:04.248077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 07:59:04.249231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 493/962] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 07:59:04 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:04.260924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.262003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.262003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.262003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.262003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.262528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:04.262528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.262528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.269411 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 470/963] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:04.274943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.372925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699846-8cbc-4595-9909-ee0e96cdf5ec None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.385308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:04.386131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472a763-0fdc-49a2-825d-4b73f9f532de None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.388463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:04.415003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d28e9-a9ce-4644-8b75-e69d55e5c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.415848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d28e9-a9ce-4644-8b75-e69d55e5c657 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.416169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d28e9-a9ce-4644-8b75-e69d55e5c657 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.416582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d28e9-a9ce-4644-8b75-e69d55e5c657 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.425382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d28e9-a9ce-4644-8b75-e69d55e5c657 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.425517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f61055-cd5a-4616-be6c-ecf720d1574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.426140 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61055-cd5a-4616-be6c-ecf720d1574e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.426455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61055-cd5a-4616-be6c-ecf720d1574e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.426769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61055-cd5a-4616-be6c-ecf720d1574e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.427214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d28e9-a9ce-4644-8b75-e69d55e5c657 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.435050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f61055-cd5a-4616-be6c-ecf720d1574e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.436494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f61055-cd5a-4616-be6c-ecf720d1574e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-fe1d28e9-a9ce-4644-8b75-e69d55e5c657 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:59:04.439897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:04.441012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.442003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 494/964] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:04.442671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d1ce1-096e-4542-8cc3-393972b6f961 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.443242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d1ce1-096e-4542-8cc3-393972b6f961 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.443340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d1ce1-096e-4542-8cc3-393972b6f961 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.451517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 495/965] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:04.451517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d1ce1-096e-4542-8cc3-393972b6f961 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-12f61055-cd5a-4616-be6c-ecf720d1574e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:59:04.457156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:04.458636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 471/966] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f9564-70cc-4aff-bc67-770808e67d45 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.460997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f9564-70cc-4aff-bc67-770808e67d45 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.462796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f9564-70cc-4aff-bc67-770808e67d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.478513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f35f9564-70cc-4aff-bc67-770808e67d45 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:04.480377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f35f9564-70cc-4aff-bc67-770808e67d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:04.554598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 472/967] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:04.555951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f9564-70cc-4aff-bc67-770808e67d45 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.582114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d1ce1-096e-4542-8cc3-393972b6f961 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.622785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.623394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.623697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.623969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.624839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:04.625143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.626763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.650146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:04.660885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f9564-70cc-4aff-bc67-770808e67d45 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.664912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 496/968] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:04.665744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.707365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:04.712721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.714161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.714591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.715093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.716264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:04.716853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.718315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.739942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 473/969] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:04.746507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.805034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79368d9-0e6a-4c7f-9529-42549a0dd4f8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.849581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.850226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.850508 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.850782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.851406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:04.852795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:04.862983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:04.864143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:04.865055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 497/970] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:04.870765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:04.883580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211af64-1362-49e9-a7de-55b8b0639f0f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:04.928584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c64f5-db80-43e9-8965-011b5e141fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:04.929496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c64f5-db80-43e9-8965-011b5e141fff None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:04.929953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c64f5-db80-43e9-8965-011b5e141fff None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:04.930404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c64f5-db80-43e9-8965-011b5e141fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:04.955100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:04.989271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:05.005488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c997eef-e954-4281-b690-82e8bc05642a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:05.022839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c64f5-db80-43e9-8965-011b5e141fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.024388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c64f5-db80-43e9-8965-011b5e141fff None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.043150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:05.044000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.044273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.044539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.045173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:05.045471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.046962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.056821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 498/971] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:05.058406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:05.127464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 474/972] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:04 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 07:59:05.128804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413465e-9067-4247-9ac9-ed91301a7f6a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.129093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413465e-9067-4247-9ac9-ed91301a7f6a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.129368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413465e-9067-4247-9ac9-ed91301a7f6a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.130602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 475/973] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:05.136045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413465e-9067-4247-9ac9-ed91301a7f6a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:05.161735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ae772-fdc7-4390-ba50-28f0242067b3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:05.187348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:05.195494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c63b7-ff44-4a86-ba95-dd6ba71ea443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:05.196100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c63b7-ff44-4a86-ba95-dd6ba71ea443 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.196374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c63b7-ff44-4a86-ba95-dd6ba71ea443 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.196652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c63b7-ff44-4a86-ba95-dd6ba71ea443 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.197278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c63b7-ff44-4a86-ba95-dd6ba71ea443 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:05.197580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c63b7-ff44-4a86-ba95-dd6ba71ea443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.199695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c63b7-ff44-4a86-ba95-dd6ba71ea443 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.204389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 499/974] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:05.204389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e4ee-5450-4f70-96b3-04bd49d6d657 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.204389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e4ee-5450-4f70-96b3-04bd49d6d657 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.204389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e4ee-5450-4f70-96b3-04bd49d6d657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.224181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e0a2e4ee-5450-4f70-96b3-04bd49d6d657 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:05.225696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e0a2e4ee-5450-4f70-96b3-04bd49d6d657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:05.238836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413465e-9067-4247-9ac9-ed91301a7f6a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:05.239623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:05.274050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:05.274671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.274944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.275222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.285109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.286543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.292468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 500/975] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:05.293305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2e4ee-5450-4f70-96b3-04bd49d6d657 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:05.311567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:05.312565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:05.313525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:05.313525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:05.313525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:05.313525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 476/976] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:05.315748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:05.399565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2e4ee-5450-4f70-96b3-04bd49d6d657 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:05.412563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b6422-eb5c-4af3-8d7a-d90cdb80f4b7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:05.414055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:05.434745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:05.435387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.435696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.435970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.436628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.438048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.452374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:05.453021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.453300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.453568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.454255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.455605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.471446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 501/977] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:59:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:05.471446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:05.471446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:05.493521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 477/978] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:59:05 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:59:05.597311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120196ad-edfc-4406-a8eb-3c7fcaf2bbfd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:05.649759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:05.650377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.650654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.651572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.652298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:05.652505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.653947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.666833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 502/979] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:05.673280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:05.782269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a959-46f1-41f1-a39c-9438a7238024 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:05.817158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:05.817788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:05.818065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:05.818334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:05.825889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:05.827442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:59:05.839657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:05.840665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:05.841586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 478/980] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:05.846637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:05.916468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:05.964294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8f56-5e21-4966-aa54-f247dd7cd498 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:06.001006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a201b3c-e3b7-4216-8d90-eb1029a348e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:06.001681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201b3c-e3b7-4216-8d90-eb1029a348e2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:06.002000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201b3c-e3b7-4216-8d90-eb1029a348e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:06.002321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201b3c-e3b7-4216-8d90-eb1029a348e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:06.003058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a201b3c-e3b7-4216-8d90-eb1029a348e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:06.003399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a201b3c-e3b7-4216-8d90-eb1029a348e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:06.004990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a201b3c-e3b7-4216-8d90-eb1029a348e2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:06.019814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 503/981] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:06.026114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:06.051965 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:06.132957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963f18-04b7-4483-bfbe-70afba1e7db4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:06.167085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a48b10-0d9a-4d02-8d96-93118aba7fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:06.167697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a48b10-0d9a-4d02-8d96-93118aba7fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:06.167995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a48b10-0d9a-4d02-8d96-93118aba7fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:06.168287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a48b10-0d9a-4d02-8d96-93118aba7fd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:06.169058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a48b10-0d9a-4d02-8d96-93118aba7fd7 None admin] RBAC: Adding query filter params (role.id=5514b5ec965047d9ae1f64916f0582a9, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=3a5c88198c71414e99118fe595ad002c) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:06.169367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a48b10-0d9a-4d02-8d96-93118aba7fd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:06.170791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a48b10-0d9a-4d02-8d96-93118aba7fd7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:06.183620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 479/982] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:06 2022] GET /identity/v3/role_assignments?user.id=3a5c88198c71414e99118fe595ad002c&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=5514b5ec965047d9ae1f64916f0582a9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:07.535640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563cce-d555-432b-ab76-d630d4cb3299 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:07.536188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563cce-d555-432b-ab76-d630d4cb3299 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:07.536188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563cce-d555-432b-ab76-d630d4cb3299 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:07.537659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 504/983] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:07.542759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ee91-979e-49ea-9115-e6b79ed90393 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:07.543215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ee91-979e-49ea-9115-e6b79ed90393 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:07.543299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ee91-979e-49ea-9115-e6b79ed90393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:07.562332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7307ee91-979e-49ea-9115-e6b79ed90393 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:07.563462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7307ee91-979e-49ea-9115-e6b79ed90393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:07.607363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a5d7-7cb8-46fc-a3a0-ce786d7b5ce3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:07.607678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a5d7-7cb8-46fc-a3a0-ce786d7b5ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:07.607962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a5d7-7cb8-46fc-a3a0-ce786d7b5ce3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:07.609299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 505/984] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:59:07.614204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a04d-d7f9-402b-8b18-9ad9f767d787 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:07.614467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a04d-d7f9-402b-8b18-9ad9f767d787 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:07.614738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a04d-d7f9-402b-8b18-9ad9f767d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:07.635001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-74d7a04d-d7f9-402b-8b18-9ad9f767d787 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:07.636653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 480/985] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:07.637314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-74d7a04d-d7f9-402b-8b18-9ad9f767d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:07.658822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307ee91-979e-49ea-9115-e6b79ed90393 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:07.676896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:07.706855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 506/986] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:07.729026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7a04d-d7f9-402b-8b18-9ad9f767d787 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:07.770219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307ee91-979e-49ea-9115-e6b79ed90393 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:07.778742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:07.813046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:07.813596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:07.813872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:07.814140 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:07.814721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:07.816119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:07.825641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:07.826991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:07.828088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 481/987] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:59:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:07.832856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:07.842761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7a04d-d7f9-402b-8b18-9ad9f767d787 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:07.881014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:07.881643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:07.881921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:07.882192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:07.882773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:07.884400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:07.894309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:07.895821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:07.896843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 507/988] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:07.901988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:07.926306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:07.947588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b903a0-21eb-4a0d-a71c-84f2b354a914 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:07.984406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:07.985014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:07.985289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:07.985559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:07.986190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:07.986489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:07.987901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:07.998151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 482/989] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:07.999884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.022904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd468e5c-14e5-4517-bb9f-a0cf157cbfa8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.036990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:08.061513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.062120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.062443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.062671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.063347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:08.063807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.064995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.070419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 508/990] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:59:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:08.076078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.129720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c600f-8fb1-4c0c-a871-1cba712b1518 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.165645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.166284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.167073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.167335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.167984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:08.168284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.169660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.174555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 483/991] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:08.180247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.191468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:08.199693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65b9e-13e4-44fc-84bb-ac4ec4ebbacb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.235400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d460b3-2934-4ce0-9e3a-7a5cd57bf1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.236032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d460b3-2934-4ce0-9e3a-7a5cd57bf1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.236313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d460b3-2934-4ce0-9e3a-7a5cd57bf1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.236583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d460b3-2934-4ce0-9e3a-7a5cd57bf1f1 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.237211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d460b3-2934-4ce0-9e3a-7a5cd57bf1f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:08.237511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d460b3-2934-4ce0-9e3a-7a5cd57bf1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.238872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d460b3-2934-4ce0-9e3a-7a5cd57bf1f1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.243593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 509/992] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:08.244857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653da42-b7dc-45d8-a236-105bce592780 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.245145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653da42-b7dc-45d8-a236-105bce592780 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.245419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653da42-b7dc-45d8-a236-105bce592780 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.247919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 510/993] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:08.249906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653da42-b7dc-45d8-a236-105bce592780 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.281356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887910d-044d-4d00-af09-8b0aef930e40 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.294978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:08.319045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5111-b75c-4428-b874-1c59d2eaaa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.319614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5111-b75c-4428-b874-1c59d2eaaa3d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.319898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5111-b75c-4428-b874-1c59d2eaaa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.320166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5111-b75c-4428-b874-1c59d2eaaa3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.320867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5111-b75c-4428-b874-1c59d2eaaa3d None admin] RBAC: Adding query filter params (interface=admin, service_id=2fc7ca7119db4261b20ea006ca0dc6f7, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:08.321172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5111-b75c-4428-b874-1c59d2eaaa3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.322595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5111-b75c-4428-b874-1c59d2eaaa3d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.327712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 484/994] 10.222.0.40 () {56 vars in 1249 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/endpoints?service_id=2fc7ca7119db4261b20ea006ca0dc6f7&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:08.328937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a851-f40d-491a-9077-b0838317f31b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.329223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a851-f40d-491a-9077-b0838317f31b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.329495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a851-f40d-491a-9077-b0838317f31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.347515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-94d2a851-f40d-491a-9077-b0838317f31b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:08.348717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-94d2a851-f40d-491a-9077-b0838317f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:08.356990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653da42-b7dc-45d8-a236-105bce592780 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.389962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.390562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.390846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.391117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.391838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] RBAC: Adding query filter params (interface=public, service_id=d1e760cbc34a4e8ab90409047093c7cf, region_id=RegionOne) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:08.392146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.393511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.398371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 511/995] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/endpoints?service_id=d1e760cbc34a4e8ab90409047093c7cf&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:08.399218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.417109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 485/996] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:08.417935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a851-f40d-491a-9077-b0838317f31b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.420281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:08.503546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb4cbb-c1d8-4cbf-9a60-2d742a776ac5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.505823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:08.522115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a851-f40d-491a-9077-b0838317f31b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.539732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.540916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.541198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.541514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.542126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.543565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.549840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 512/997] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:59:08.550624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.569611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.570168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.570424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.570699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.571320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.573455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.580583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 486/998] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:59:08.683543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17215921-47d3-4456-9578-66956c593ee6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.723505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.724150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.724489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.724726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] PATH_INFO: `/v3/services/image` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.725272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.726650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:08.736259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:08.737330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:08.738200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 513/999] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:08.743399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.813537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:08.849882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51976ce1-1da8-4ed3-9eed-aca21b770432 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:08.884732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987162f-17ea-4753-a438-b921c9d0c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:08.885930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987162f-17ea-4753-a438-b921c9d0c19c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:08.886201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987162f-17ea-4753-a438-b921c9d0c19c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:08.886471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987162f-17ea-4753-a438-b921c9d0c19c None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:08.887093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987162f-17ea-4753-a438-b921c9d0c19c None admin] RBAC: Adding query filter params (name=image) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:08.887388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987162f-17ea-4753-a438-b921c9d0c19c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:08.888776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987162f-17ea-4753-a438-b921c9d0c19c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:08.893773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 487/1000] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:08.899608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:08.933352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:09.004743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f4ca-8508-4658-b199-256abbd940ae None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:09.040906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851d269-af8b-4cae-a2da-c698085986da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:09.042081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d269-af8b-4cae-a2da-c698085986da None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:09.042352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d269-af8b-4cae-a2da-c698085986da None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:09.042688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d269-af8b-4cae-a2da-c698085986da None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:09.043461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851d269-af8b-4cae-a2da-c698085986da None admin] RBAC: Adding query filter params (type=image) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:09.043764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851d269-af8b-4cae-a2da-c698085986da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:09.045114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851d269-af8b-4cae-a2da-c698085986da None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:09.049899 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 514/1001] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:10.647240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60dd2b-ae8e-4347-a04f-60b0957784cf None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:10.647750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60dd2b-ae8e-4347-a04f-60b0957784cf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:10.647750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60dd2b-ae8e-4347-a04f-60b0957784cf None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:10.649214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 488/1002] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:59:10.653479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12d62-54a9-4386-ae86-66b9c7660b36 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:10.654040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12d62-54a9-4386-ae86-66b9c7660b36 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:10.654040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12d62-54a9-4386-ae86-66b9c7660b36 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:10.654574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e3993-f70b-4af3-822c-5b42f678a096 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:10.654855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e3993-f70b-4af3-822c-5b42f678a096 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:10.655132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e3993-f70b-4af3-822c-5b42f678a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:10.655742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 515/1003] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:10.660686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f7ae-86e5-4593-8814-22b5e2995024 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:10.660964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f7ae-86e5-4593-8814-22b5e2995024 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:10.661263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f7ae-86e5-4593-8814-22b5e2995024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:10.673660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-dc6e3993-f70b-4af3-822c-5b42f678a096 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:10.674861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dc6e3993-f70b-4af3-822c-5b42f678a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:10.679635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c6b5f7ae-86e5-4593-8814-22b5e2995024 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:10.680801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c6b5f7ae-86e5-4593-8814-22b5e2995024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:10.744653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 489/1004] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:10.754402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 516/1005] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:10.767700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e3993-f70b-4af3-822c-5b42f678a096 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:10.779278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f7ae-86e5-4593-8814-22b5e2995024 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:10.808591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:10.832058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:10.877125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e3993-f70b-4af3-822c-5b42f678a096 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:10.894187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f7ae-86e5-4593-8814-22b5e2995024 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:10.913676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:10.914238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:10.914515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:10.915070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:10.915700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:10.917334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:10.926826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:10.931636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:10.933045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 490/1006] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:10.934571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:10.939917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:10.940561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:10.940841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:10.941116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:10.941703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:10.943083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:10.953566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:10.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:10.955797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 517/1007] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 07:59:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:10.960939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:11.051021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7361-fc64-40e3-8e00-33be9579d505 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:11.054247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:11.065553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97aef-be07-4def-9a9b-26c79efc704f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:11.075287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:11.087434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e351f-5f70-4414-9fb0-592e0cd0785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:11.088625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e351f-5f70-4414-9fb0-592e0cd0785f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.089073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e351f-5f70-4414-9fb0-592e0cd0785f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.089359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e351f-5f70-4414-9fb0-592e0cd0785f None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.089979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e351f-5f70-4414-9fb0-592e0cd0785f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:11.090268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e351f-5f70-4414-9fb0-592e0cd0785f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:11.091650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e351f-5f70-4414-9fb0-592e0cd0785f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:11.096525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 491/1008] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:59:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:11.097678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43de96-699e-41e8-866e-a6d030146d9b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.097960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43de96-699e-41e8-866e-a6d030146d9b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.098233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43de96-699e-41e8-866e-a6d030146d9b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.099750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 492/1009] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:11.100817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8ef56-a261-44f1-bc0a-9a20d9292920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:11.101496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8ef56-a261-44f1-bc0a-9a20d9292920 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.101781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8ef56-a261-44f1-bc0a-9a20d9292920 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.102060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8ef56-a261-44f1-bc0a-9a20d9292920 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.102159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43de96-699e-41e8-866e-a6d030146d9b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:11.102687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8ef56-a261-44f1-bc0a-9a20d9292920 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:11.102988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8ef56-a261-44f1-bc0a-9a20d9292920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:11.104549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8ef56-a261-44f1-bc0a-9a20d9292920 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:11.114010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 518/1010] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:11.114010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c3498-fa21-4a5d-ac20-696ac93c4935 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.114010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c3498-fa21-4a5d-ac20-696ac93c4935 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.114010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c3498-fa21-4a5d-ac20-696ac93c4935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.128985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e74c3498-fa21-4a5d-ac20-696ac93c4935 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:11.130179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e74c3498-fa21-4a5d-ac20-696ac93c4935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:11.196933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 519/1011] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:11.198265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c3498-fa21-4a5d-ac20-696ac93c4935 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:11.207071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43de96-699e-41e8-866e-a6d030146d9b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:11.241433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:11.242030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.242304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.242574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.243194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] RBAC: Adding query filter params (type=compute) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:11.243524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:11.245604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:11.250320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 493/1012] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 07:59:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:11.251063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:11.296487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:11.309711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:11.313861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c3498-fa21-4a5d-ac20-696ac93c4935 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:11.358303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9bc53-7397-42b1-be8a-96abf3cd2cff None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:11.358680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:11.359287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.359590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.359865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.360482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:11.360779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:11.362134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:11.366753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 520/1013] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 07:59:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:11.367519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:11.393545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:11.394153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.394429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.394700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.395336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:11.396724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:11.411271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 494/1014] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:59:11 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:11.412128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:11.482330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e16e-c712-47c6-89d3-883569f28f25 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:11.524744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12f1fb-fdcc-4076-ab7c-fcab2844b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:11.525359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12f1fb-fdcc-4076-ab7c-fcab2844b02c None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.525807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12f1fb-fdcc-4076-ab7c-fcab2844b02c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.526111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12f1fb-fdcc-4076-ab7c-fcab2844b02c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.526781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12f1fb-fdcc-4076-ab7c-fcab2844b02c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:11.528201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12f1fb-fdcc-4076-ab7c-fcab2844b02c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:11.534036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8146-8076-483f-964c-e7e92c71b62a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:11.545152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:11.551805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 521/1015] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:59:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:11.560334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:11.594488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532087e8-0a1e-442f-b32d-5f39afd6778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:11.595105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532087e8-0a1e-442f-b32d-5f39afd6778a None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:11.595382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532087e8-0a1e-442f-b32d-5f39afd6778a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:11.595702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532087e8-0a1e-442f-b32d-5f39afd6778a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:11.596361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532087e8-0a1e-442f-b32d-5f39afd6778a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:11.597838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532087e8-0a1e-442f-b32d-5f39afd6778a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:11.627734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 495/1016] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:59:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:13.494857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd617c-247e-484b-ba2c-773147b091fd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.495376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd617c-247e-484b-ba2c-773147b091fd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.495641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd617c-247e-484b-ba2c-773147b091fd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.496812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 522/1017] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:13.501826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4013b-e2b4-4936-8787-d1992090c135 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.502209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4013b-e2b4-4936-8787-d1992090c135 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.502407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4013b-e2b4-4936-8787-d1992090c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.520626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0bc4013b-e2b4-4936-8787-d1992090c135 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:13.521799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0bc4013b-e2b4-4936-8787-d1992090c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:13.596019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 496/1018] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:13.618584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd617c-247e-484b-ba2c-773147b091fd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:13.673746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c5c7-5001-4ec5-ac3e-f5c17daa86f5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.674019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c5c7-5001-4ec5-ac3e-f5c17daa86f5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.674300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c5c7-5001-4ec5-ac3e-f5c17daa86f5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.675956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 497/1019] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:59:13.680609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71df8a-e405-4713-abd9-90ead6d234e0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.680883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71df8a-e405-4713-abd9-90ead6d234e0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.681152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71df8a-e405-4713-abd9-90ead6d234e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.699222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1b71df8a-e405-4713-abd9-90ead6d234e0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:13.700509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1b71df8a-e405-4713-abd9-90ead6d234e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:13.729905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd617c-247e-484b-ba2c-773147b091fd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:13.763771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:13.764889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.765427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.766048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] PATH_INFO: `/v3/services/image` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.767117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:13.769244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:13.770481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 498/1020] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:13.771866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6037fce-9df8-45f5-a05f-ccc745fa736f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.772159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6037fce-9df8-45f5-a05f-ccc745fa736f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.772433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6037fce-9df8-45f5-a05f-ccc745fa736f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.773672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 499/1021] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:13.779259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b7dc-2e42-45da-a0ab-9f0d192a3486 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:13.779384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:13.780414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:13.781304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:13.782088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b7dc-2e42-45da-a0ab-9f0d192a3486 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.782088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b7dc-2e42-45da-a0ab-9f0d192a3486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.782215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 523/1022] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 10 07:59:13 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:13.789349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:13.806095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-aa67b7dc-2e42-45da-a0ab-9f0d192a3486 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:13.808134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-aa67b7dc-2e42-45da-a0ab-9f0d192a3486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:13.825307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:13.855103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:13.876925 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 500/1023] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:13.877670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b7dc-2e42-45da-a0ab-9f0d192a3486 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:13.894969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8789-f701-49ea-9e98-8221be706c1a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:13.929541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:13.930147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:13.930415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:13.930683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:13.931351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] RBAC: Adding query filter params (name=image) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:13.932276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:13.933673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:13.938425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 524/1024] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:13.939185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:13.984436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b7dc-2e42-45da-a0ab-9f0d192a3486 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.020887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.021550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.021832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.022123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.023263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.024746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.026576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 501/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:14.027470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.037951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220913f-6edd-491d-a4cd-fa489eaa7ccc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.055112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:14.065264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:14.073848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.074472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.074748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.075018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.085323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:14.090102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:14.091027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 525/1026] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 07:59:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:14.091926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.136502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a5b7-0c05-4559-a6cb-c94f70344334 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.171799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.172498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.172778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.173049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.173673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:14.173972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.175339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.180143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 502/1027] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:14.180902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.191842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ec27-4275-4ff6-85b0-77ad987dd9f9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.224938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.225536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.225809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.226078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.226702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.228135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.255126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 526/1028] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:59:14 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:14.255964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.268466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:14.287917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0d1-16d9-4984-9b2e-9e933c28d5c2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.319160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:14.336366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.337253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.337591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.337887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.338566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:14.338863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.340301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.349029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 503/1029] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:14.354874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.394335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b822a-3ba0-4f65-89d3-cd1930f48903 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.434747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.435373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.435687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.435958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.436671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] RBAC: Adding query filter params (interface=public, service_id=c3d6159daf0c4bd986fbff2054be0e43, region_id=RegionOne) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:14.436981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.438336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.443907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 527/1030] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/endpoints?service_id=c3d6159daf0c4bd986fbff2054be0e43&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:14.451353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.477023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801552-27d8-457e-89dd-64ca4a69137a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.513675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.514306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.514585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.514858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.525908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.527679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.535878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:14.543313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:14.544517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:14.545653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:14.545653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:14.545653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:14.547187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 504/1031] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:14.553382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.576295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64488-fec9-45b0-84bb-0f44faa2f840 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.580034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:14.624627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.625333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.625574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.625883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.626614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.628217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.643449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 528/1032] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 07:59:14.674296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbb423-9734-4137-8765-8808a45b2506 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.712032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.712657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.712978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.713338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.714106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:14.714408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.715853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.729844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 505/1033] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:14.735549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.848918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566b29c-a268-4ab7-890f-8b7aec1a09a0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:14.883525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:14.884142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:14.884421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:14.884692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:14.892166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:14.893575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:59:14.904785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:14.905772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:14.911984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 529/1034] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:14.912648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:14.976587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:15.020737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8a68-836c-4cac-8362-da46e1dd3eea None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:15.055999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:15.056642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:15.057185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:15.057458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:15.058180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:15.058484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:15.059941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:15.077361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 506/1035] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:59:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:15.082994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:15.113578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:15.188970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28624e02-044f-48f4-ae55-4dab307fb2cf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:15.223659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:15.224267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:15.224547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:15.224821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:15.294079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:15.295579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:15.324187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:15.402969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 530/1036] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:15 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:15.404577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:15.507927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efd3ad-c702-426c-8839-871f0b315d15 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:15.525666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:15.544616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:15.545184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:15.545459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:15.545729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:15.555670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:15.557763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:15.572844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:15.573798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:15.582861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:15.582861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:15.582861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:15.582861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 507/1037] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:15.583160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:15.680865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1742-d11d-4146-ba55-c78eecab5dc7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:15.706739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:15.716003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:15.716610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:15.716890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:15.717162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:15.717804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:15.718105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:15.719554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:15.735969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 531/1038] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:15.737098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:15.849624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881d18-b877-495e-a98b-887fd2a9ffb2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:15.883916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:15.884540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:15.884844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:15.885119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:15.891978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:15.893422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:59:15.905345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:15.906278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:15.907223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 508/1039] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:15.914259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:16.020489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eaca3-43fe-47f8-9beb-b2b029a03529 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:16.059519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557a10a-c339-4163-a701-35a0b6055db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:16.060117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557a10a-c339-4163-a701-35a0b6055db7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.060388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557a10a-c339-4163-a701-35a0b6055db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.060653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557a10a-c339-4163-a701-35a0b6055db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.061334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557a10a-c339-4163-a701-35a0b6055db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:16.061633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557a10a-c339-4163-a701-35a0b6055db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:16.063047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557a10a-c339-4163-a701-35a0b6055db7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:16.075364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 532/1040] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:16.081161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:16.112945 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:16.185667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1f9a-3cbd-4687-b973-fdba3384584f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:16.219085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475a46-e755-4c73-990a-41acb2a94a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:16.219719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475a46-e755-4c73-990a-41acb2a94a18 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.219990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475a46-e755-4c73-990a-41acb2a94a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.220254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475a46-e755-4c73-990a-41acb2a94a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.220964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475a46-e755-4c73-990a-41acb2a94a18 None admin] RBAC: Adding query filter params (role.id=5514b5ec965047d9ae1f64916f0582a9, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=b4e95079af6b4768bc38709a8bdc27bf) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:16.221263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475a46-e755-4c73-990a-41acb2a94a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:16.222673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475a46-e755-4c73-990a-41acb2a94a18 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:16.235702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 509/1041] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:16 2022] GET /identity/v3/role_assignments?user.id=b4e95079af6b4768bc38709a8bdc27bf&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=5514b5ec965047d9ae1f64916f0582a9 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:16.328348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac123c-95a0-4f9e-a14c-a45c02d2ac8b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.328673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac123c-95a0-4f9e-a14c-a45c02d2ac8b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.328907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac123c-95a0-4f9e-a14c-a45c02d2ac8b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.330455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 533/1042] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:16.335987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a429-98e9-4c85-9505-7f3f26bcb2b5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.336292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a429-98e9-4c85-9505-7f3f26bcb2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.336542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a429-98e9-4c85-9505-7f3f26bcb2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.356324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9b21a429-98e9-4c85-9505-7f3f26bcb2b5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:16.357539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9b21a429-98e9-4c85-9505-7f3f26bcb2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:16.432388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 510/1043] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:16.457010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac123c-95a0-4f9e-a14c-a45c02d2ac8b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:16.510812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:16.564641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac123c-95a0-4f9e-a14c-a45c02d2ac8b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:16.599687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5cccc-6943-4a06-a442-f5e765f1dd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:16.600340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5cccc-6943-4a06-a442-f5e765f1dd32 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.600607 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5cccc-6943-4a06-a442-f5e765f1dd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.600873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5cccc-6943-4a06-a442-f5e765f1dd32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.602074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5cccc-6943-4a06-a442-f5e765f1dd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:16.603675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5cccc-6943-4a06-a442-f5e765f1dd32 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:16.610226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 534/1044] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:16.611558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a429-98e9-4c85-9505-7f3f26bcb2b5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:16.638383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:16.717267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a429-98e9-4c85-9505-7f3f26bcb2b5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:16.733703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63876-2c7d-456f-ad74-2b55865e4768 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.734057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63876-2c7d-456f-ad74-2b55865e4768 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.734259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63876-2c7d-456f-ad74-2b55865e4768 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.735625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 535/1045] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:59:16.740795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8357ff-cb00-49a9-b7d3-1d39e0d964c4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.741073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8357ff-cb00-49a9-b7d3-1d39e0d964c4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.741345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8357ff-cb00-49a9-b7d3-1d39e0d964c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.753200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:16.754081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:16.754542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:16.754996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:16.755881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:16.757500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:16.759188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1f8357ff-cb00-49a9-b7d3-1d39e0d964c4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:16.761066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1f8357ff-cb00-49a9-b7d3-1d39e0d964c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:16.783227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 511/1046] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:59:16 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:59:16.847454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 536/1047] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:16.870306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:16.962805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:16.986388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4918c-75a0-4cc2-90dd-824d155fdcf3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:17.023692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:17.024331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:17.024609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:17.024881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] PATH_INFO: `/v3/services/image` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:17.026044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:17.027435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:17.036543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:17.037592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:17.038510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 512/1048] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 10 07:59:16 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:17.043604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8357ff-cb00-49a9-b7d3-1d39e0d964c4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:17.091772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:17.146274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8357ff-cb00-49a9-b7d3-1d39e0d964c4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:17.180074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:17.180681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:17.180981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:17.181228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:17.182944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] RBAC: Adding query filter params (name=image) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:17.183129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:17.184477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:17.194339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 537/1049] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:17.195940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:17.314537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63c9a-42e3-4173-9f91-0d41280cc339 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:17.351071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69e462-6119-44e4-8cb3-87ea5e7c23c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:17.351710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e462-6119-44e4-8cb3-87ea5e7c23c8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:17.351985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e462-6119-44e4-8cb3-87ea5e7c23c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:17.352256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e462-6119-44e4-8cb3-87ea5e7c23c8 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:17.352887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69e462-6119-44e4-8cb3-87ea5e7c23c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:17.353182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69e462-6119-44e4-8cb3-87ea5e7c23c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:17.354730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69e462-6119-44e4-8cb3-87ea5e7c23c8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:17.363579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 513/1050] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:17.365772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:17.472083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f790-a602-4b68-ae95-7319474631bf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:17.482690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:17.508405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d37f2-cc88-449b-b5d2-8c1d33448942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:17.509267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d37f2-cc88-449b-b5d2-8c1d33448942 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:17.510311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d37f2-cc88-449b-b5d2-8c1d33448942 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:17.510730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d37f2-cc88-449b-b5d2-8c1d33448942 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:17.511574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d37f2-cc88-449b-b5d2-8c1d33448942 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:17.513088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d37f2-cc88-449b-b5d2-8c1d33448942 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:17.539815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 538/1051] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 07:59:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:59:18.292515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429ce91-7a1a-4175-81ee-7d6ca90bd038 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:18.292515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429ce91-7a1a-4175-81ee-7d6ca90bd038 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:18.293095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429ce91-7a1a-4175-81ee-7d6ca90bd038 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:18.294330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 514/1052] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:18.301444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1220-8a63-4b30-a331-23da2ebbbde9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:18.301444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1220-8a63-4b30-a331-23da2ebbbde9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:18.301444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1220-8a63-4b30-a331-23da2ebbbde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:18.318705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4b4f1220-8a63-4b30-a331-23da2ebbbde9 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:18.319923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4b4f1220-8a63-4b30-a331-23da2ebbbde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:18.394920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 539/1053] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:18.417890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429ce91-7a1a-4175-81ee-7d6ca90bd038 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:18.429198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:18.522338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429ce91-7a1a-4175-81ee-7d6ca90bd038 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:18.556038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:18.557043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:18.557386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:18.557657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:18.568289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:18.573562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:18.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:18.575358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:18.579785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 515/1054] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 07:59:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:18.580598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1220-8a63-4b30-a331-23da2ebbbde9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:18.672909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:18.685354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1220-8a63-4b30-a331-23da2ebbbde9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:18.720379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f1250-ded4-4ed7-9b95-3247ab1a8103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:18.720986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f1250-ded4-4ed7-9b95-3247ab1a8103 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:18.721262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f1250-ded4-4ed7-9b95-3247ab1a8103 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:18.721532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f1250-ded4-4ed7-9b95-3247ab1a8103 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:18.722191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f1250-ded4-4ed7-9b95-3247ab1a8103 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:18.722492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f1250-ded4-4ed7-9b95-3247ab1a8103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:18.723889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f1250-ded4-4ed7-9b95-3247ab1a8103 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:18.732451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 540/1055] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 07:59:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:18.738469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:18.806241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:18.842394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e0902-47fe-45f5-a43c-e4d46c5fc0a3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:18.875891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:18.876515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:18.876794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:18.877066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:18.888254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:18.888517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca96a8-01ae-4e4c-90a3-70f8ca1bb057 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:18.888800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca96a8-01ae-4e4c-90a3-70f8ca1bb057 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:18.889073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca96a8-01ae-4e4c-90a3-70f8ca1bb057 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:18.889713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:18.890553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 541/1056] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:59:18.895165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc796cf-a196-4b79-a11b-35793cd84311 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:18.895466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc796cf-a196-4b79-a11b-35793cd84311 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:18.895739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc796cf-a196-4b79-a11b-35793cd84311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:18.903941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:18.904991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:18.906375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:18.906375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:18.906375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:18.909664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 516/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:18.910435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:18.913614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1fc796cf-a196-4b79-a11b-35793cd84311 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:18.914846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1fc796cf-a196-4b79-a11b-35793cd84311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:18.985355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 542/1058] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:19.010435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc796cf-a196-4b79-a11b-35793cd84311 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.017589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a021d3d-0c57-41e3-af7b-b07510dcc4b6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.039063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.054894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.055551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.055882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.056107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.057201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:19.057436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.058813 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.070753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 517/1059] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:19.077156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.101336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.118399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc796cf-a196-4b79-a11b-35793cd84311 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.155447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.156370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.156976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.157248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.168323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:19.173402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:19.174372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:19.175393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 543/1060] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:19.180410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.184847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358b0ce-c4d5-42f7-81ac-e293edff1e0b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.221422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.222048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.222326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.222625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.230412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.231899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:59:19.243470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:19.244540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:19.245514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 518/1061] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:19.250341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.295215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c795cff-f9b7-4c52-80ec-b60d49e21466 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.296818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.336679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.337950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.338370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.338781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.339614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:19.340075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.341572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.350623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 544/1062] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:19.357014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.366762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.368119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3194-9a91-4324-a847-bb7c314e9470 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.406513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.407123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.407406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.407699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.408426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:19.408726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.410168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.428871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 519/1063] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:19.435532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.469419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88eb1a-c887-4ee9-86e4-b980459e78a6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.505898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.506529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.506812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.507083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] PATH_INFO: `/v3/users/24b5635333a14a43ab1d33ba5d5e7ad2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.520533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] RBAC: Authorizing `identity:get_user(user_id=24b5635333a14a43ab1d33ba5d5e7ad2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.521962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.529003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 545/1064] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/users/24b5635333a14a43ab1d33ba5d5e7ad2 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:19.529718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.536007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.542689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a898e-d284-41f4-ac9e-fa29f8b377e2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.579242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e67374-b954-4bb9-bdd7-c8532eb3e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.579912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e67374-b954-4bb9-bdd7-c8532eb3e00c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.580190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e67374-b954-4bb9-bdd7-c8532eb3e00c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.580461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e67374-b954-4bb9-bdd7-c8532eb3e00c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.591233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e67374-b954-4bb9-bdd7-c8532eb3e00c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.592632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e67374-b954-4bb9-bdd7-c8532eb3e00c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.595953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-07e67374-b954-4bb9-bdd7-c8532eb3e00c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:19.609122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:19.615346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 520/1065] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed776ae-da0e-404f-a72c-58ac0b86bd5c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed776ae-da0e-404f-a72c-58ac0b86bd5c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed776ae-da0e-404f-a72c-58ac0b86bd5c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.616407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 521/1066] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:19.617967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed776ae-da0e-404f-a72c-58ac0b86bd5c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.637003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceddcd-3f87-43e1-b59e-f2ff24537575 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.671022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.671674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.671952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.672213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.722519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed776ae-da0e-404f-a72c-58ac0b86bd5c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.740473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.741928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.757543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dce6b-d011-467e-9612-fb017c6a9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.758228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dce6b-d011-467e-9612-fb017c6a9d98 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.758512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dce6b-d011-467e-9612-fb017c6a9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.758785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dce6b-d011-467e-9612-fb017c6a9d98 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.759928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dce6b-d011-467e-9612-fb017c6a9d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:19.760234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dce6b-d011-467e-9612-fb017c6a9d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.761709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dce6b-d011-467e-9612-fb017c6a9d98 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.773123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 522/1067] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:19.774306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73c5a-facd-4a4d-b569-8720fa6f5c7b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.774555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73c5a-facd-4a4d-b569-8720fa6f5c7b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.774831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73c5a-facd-4a4d-b569-8720fa6f5c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.792589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0cc73c5a-facd-4a4d-b569-8720fa6f5c7b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:19.793781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0cc73c5a-facd-4a4d-b569-8720fa6f5c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:19.796594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.803449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:19.847241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 546/1068] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:19.848023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.863775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 523/1069] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:19.864611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc73c5a-facd-4a4d-b569-8720fa6f5c7b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:19.952623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491ee89-c7fc-42e8-b139-4568227045ce None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.964534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc73c5a-facd-4a4d-b569-8720fa6f5c7b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:19.986423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.987045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.987320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:19.987614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:19.994221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:19.995681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:19.998855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:19.999517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:19.999795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:20.000064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:20.001175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] RBAC: Authorizing `identity:get_project(project_id=83eae71c7cf14a7aac8a0f547aa12b2d)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:20.002620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:20.004361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 524/1070] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:20.005210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:59:20.006405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:20.007659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:20.009114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 547/1071] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:20.012311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:20.023383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:20.038239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:20.113255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a33d4-8afe-4df5-95b7-74b7f9143d26 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:20.116424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537cbec-3c16-4ae3-8342-9b564d0a2cb3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:20.147050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:20.147670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:20.147941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:20.148204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:20.149807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:20.150438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:20.150711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:20.150983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:20.151730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d, user.id=24b5635333a14a43ab1d33ba5d5e7ad2) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:20.152032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:20.153458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:20.158883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 548/1072] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:20 2022] GET /identity/v3/role_assignments?user.id=24b5635333a14a43ab1d33ba5d5e7ad2&scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:20.159679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:20.236584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:20.238105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:20.250748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:20.280716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:20.298254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb168ef0-8f44-488e-acb5-4a84bffba74f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:20.339385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:20.340147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:20.340314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:20.340582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:20.341276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:20.341575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:20.342993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:20.356676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 549/1073] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:20.358817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 525/1074] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:20.364325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:20.364546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:20.470099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0ae0-0a0d-485a-9314-f62b4146bef5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:20.473874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ec76-1031-4dbf-8bd0-6dd89955429a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:20.484959 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:20.506398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:20.507043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:20.507318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:20.507616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/b4e95079af6b4768bc38709a8bdc27bf/roles/5514b5ec965047d9ae1f64916f0582a9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:20.510342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=b4e95079af6b4768bc38709a8bdc27bf, role_id=5514b5ec965047d9ae1f64916f0582a9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:20.511817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:20.515538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f027f6-88d0-4965-b58b-95d5cbcdafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:20.516545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f027f6-88d0-4965-b58b-95d5cbcdafcb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:20.517001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f027f6-88d0-4965-b58b-95d5cbcdafcb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:20.517315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f027f6-88d0-4965-b58b-95d5cbcdafcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:20.525844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 550/1075] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:59:20 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/b4e95079af6b4768bc38709a8bdc27bf/roles/5514b5ec965047d9ae1f64916f0582a9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:59:20.530048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f027f6-88d0-4965-b58b-95d5cbcdafcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:20.531570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f027f6-88d0-4965-b58b-95d5cbcdafcb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f3f027f6-88d0-4965-b58b-95d5cbcdafcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:20.548705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:20.549794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:20.550753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:20.550753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:20.550753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:20.550753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 526/1076] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:20.560782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:20.573311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:20.683497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56750b-56bb-4e2a-9e97-491c0b68b24f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:20.720104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603f92a-2858-46a5-a684-3d413d1fd29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:20.720718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603f92a-2858-46a5-a684-3d413d1fd29c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:20.720996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603f92a-2858-46a5-a684-3d413d1fd29c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:20.721266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603f92a-2858-46a5-a684-3d413d1fd29c None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:20.721904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603f92a-2858-46a5-a684-3d413d1fd29c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:20.722205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603f92a-2858-46a5-a684-3d413d1fd29c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:20.723635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603f92a-2858-46a5-a684-3d413d1fd29c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:20.735473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 551/1077] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:22.196169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae520d-7d05-40d3-abb1-8c09063fc89a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.196761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae520d-7d05-40d3-abb1-8c09063fc89a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.196761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae520d-7d05-40d3-abb1-8c09063fc89a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.198379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 527/1078] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:22.203695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55596f-3dbd-4706-abfd-b21a08ee3601 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.204142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55596f-3dbd-4706-abfd-b21a08ee3601 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.204365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55596f-3dbd-4706-abfd-b21a08ee3601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.223620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8f55596f-3dbd-4706-abfd-b21a08ee3601 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:22.224928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8f55596f-3dbd-4706-abfd-b21a08ee3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:22.284609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:22.293003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 552/1079] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:22.314445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae520d-7d05-40d3-abb1-8c09063fc89a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:22.415613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae520d-7d05-40d3-abb1-8c09063fc89a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:22.449618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c076e2-5019-47b6-ab2f-347c5a3cd7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:22.450179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c076e2-5019-47b6-ab2f-347c5a3cd7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.450455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c076e2-5019-47b6-ab2f-347c5a3cd7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.450723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c076e2-5019-47b6-ab2f-347c5a3cd7e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.461273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c076e2-5019-47b6-ab2f-347c5a3cd7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-32c076e2-5019-47b6-ab2f-347c5a3cd7e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:22.466375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:22.467592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:22.468460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 528/1080] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:22.473531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55596f-3dbd-4706-abfd-b21a08ee3601 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:22.560538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131129-d912-428b-a50b-2bb501528013 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.560847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131129-d912-428b-a50b-2bb501528013 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.561120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131129-d912-428b-a50b-2bb501528013 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.562445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 529/1081] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 07:59:22.567257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47990-7411-4067-a894-d0624e367aeb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.567566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47990-7411-4067-a894-d0624e367aeb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.567841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47990-7411-4067-a894-d0624e367aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.570972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55596f-3dbd-4706-abfd-b21a08ee3601 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:22.585470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a5f47990-7411-4067-a894-d0624e367aeb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:22.586642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a5f47990-7411-4067-a894-d0624e367aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:22.601415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:22.606432 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:22.607028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.607301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.607596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.608249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:22.608550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:22.609889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:22.617950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 553/1082] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:22.627364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:22.661893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 530/1083] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:22.686974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f47990-7411-4067-a894-d0624e367aeb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:22.690890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:22.732011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6c25-213a-45ee-b314-79e8725e8d99 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:22.767779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:22.768404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.768683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.768951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] PATH_INFO: `/v3/users/24b5635333a14a43ab1d33ba5d5e7ad2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.770080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] RBAC: Authorizing `identity:get_user(user_id=24b5635333a14a43ab1d33ba5d5e7ad2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:22.771529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:22.773121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 554/1084] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:22 2022] GET /identity/v3/users/24b5635333a14a43ab1d33ba5d5e7ad2 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:22.779230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:22.798978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f47990-7411-4067-a894-d0624e367aeb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:22.833007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:22.833695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.833969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.834234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.844976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:22.849598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:22.850716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:22.851609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 531/1085] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 07:59:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:22.856607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:22.868367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:22.879841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbc5a9-3e0c-4eb0-8a5c-06a0023fd607 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:22.906806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:22.915738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:22.916540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.916819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.917085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.918180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] RBAC: Authorizing `identity:get_project(project_id=83eae71c7cf14a7aac8a0f547aa12b2d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:22.919618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:22.921225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 555/1086] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:22 2022] GET /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:22.927073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:22.956599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3234-dea9-47f5-93aa-d219e633ab13 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:22.997008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:22.997764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:22.998145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:22.998484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:22.999206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:22.999539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:23.000946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:23.008883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 532/1087] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 07:59:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:23.015224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:23.032736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05891597-4650-4a5a-abcc-5a5a63f6f03c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:23.065937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:23.066591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:23.066866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:23.067135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d/users/24b5635333a14a43ab1d33ba5d5e7ad2/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:23.069054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] RBAC: Authorizing `identity:create_grant(project_id=83eae71c7cf14a7aac8a0f547aa12b2d, user_id=24b5635333a14a43ab1d33ba5d5e7ad2, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:23.070503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:23.084782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 556/1088] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:59:22 2022] PUT /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d/users/24b5635333a14a43ab1d33ba5d5e7ad2/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 07:59:23.100038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:23.122261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40bfc-574e-4d40-8ae5-884e2daf78c3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:23.160336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:23.160988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:23.161265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:23.161539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:23.173526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:23.175008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:23.190982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:23.192230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:23.193156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:23.193156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:23.193156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:23.193156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 533/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:23.198809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:23.261326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:23.307750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f245ac-a305-41d9-8f72-de559c33d3fc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:23.342346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:23.342952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:23.343226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:23.343525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:23.344166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:23.344462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:23.345810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:23.358326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 557/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:23.364074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:23.470724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaaa0b-0b4b-4774-b1fd-397a7f96d2c4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:23.494633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:23.505619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:23.506248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:23.506522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:23.506791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:23.515252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:23.516665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 07:59:23.528654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:23.529690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:23.530658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 534/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 07:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:23.535765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:23.631874 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600ca5-0bab-4edc-9a15-c82f59e648c5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:23.648244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:23.666036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:23.666726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:23.667004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:23.667272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:23.668014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:23.668317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:23.669732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:23.686468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 558/1092] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 07:59:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:23.692266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:23.791504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3eac6-818b-43f9-ab54-339796a4f421 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:23.825160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:23.825762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:23.826036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:23.826302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:23.877326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:23.892916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:23.894361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:23.990684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 535/1093] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:23.996621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:24.093121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3234ab-37d1-47ca-b22e-a55d1f57a407 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:24.126357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:24.126969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:24.127242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:24.127546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:24.137222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:24.138812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:24.154308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:24.155477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 07:59:24.156411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:24.156411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 07:59:24.156411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:24.156411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 559/1094] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:24.161038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:24.247215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:24.263754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83662-b95f-429e-9d68-128a81494b18 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:24.297820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed495-14da-458a-9869-338758049199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:24.298862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed495-14da-458a-9869-338758049199 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:24.299137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed495-14da-458a-9869-338758049199 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:24.299485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed495-14da-458a-9869-338758049199 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:24.300125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed495-14da-458a-9869-338758049199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:24.300422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed495-14da-458a-9869-338758049199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:24.301808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed495-14da-458a-9869-338758049199 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:24.313633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 536/1095] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 07:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:24.319158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:24.347823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:24.417500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9d37e-0926-4198-8b5c-3bcfe14f1c7f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:24.449901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:24.450515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:24.450788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:24.451055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:24.457489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:24.458905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 07:59:24.470096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:24.471172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:24.472143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 560/1096] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 07:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 07:59:24.477032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed495-14da-458a-9869-338758049199 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:24.575370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed495-14da-458a-9869-338758049199 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:24.608517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82049abc-cad5-49bc-b168-5aaf5beddc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:24.609049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049abc-cad5-49bc-b168-5aaf5beddc50 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:24.609322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049abc-cad5-49bc-b168-5aaf5beddc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:24.609589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049abc-cad5-49bc-b168-5aaf5beddc50 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:24.610275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82049abc-cad5-49bc-b168-5aaf5beddc50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:24.610576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82049abc-cad5-49bc-b168-5aaf5beddc50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:24.612039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82049abc-cad5-49bc-b168-5aaf5beddc50 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:24.625213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 537/1097] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 07:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:24.631179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:24.715280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:24.730187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e399ea-0935-4567-81bc-73ae71e7319f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:24.763062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20975-538e-4e09-b1cf-e532aef56abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:24.763680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20975-538e-4e09-b1cf-e532aef56abd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:24.763954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20975-538e-4e09-b1cf-e532aef56abd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:24.764221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20975-538e-4e09-b1cf-e532aef56abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:24.764927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20975-538e-4e09-b1cf-e532aef56abd None admin] RBAC: Adding query filter params (role.id=5514b5ec965047d9ae1f64916f0582a9, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=b4e95079af6b4768bc38709a8bdc27bf) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:24.765228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20975-538e-4e09-b1cf-e532aef56abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:24.766621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20975-538e-4e09-b1cf-e532aef56abd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:24.772190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 561/1098] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:24 2022] GET /identity/v3/role_assignments?user.id=b4e95079af6b4768bc38709a8bdc27bf&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=5514b5ec965047d9ae1f64916f0582a9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:25.120510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc03dd-4714-4bff-af9f-b34cfd0a706a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:25.120786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc03dd-4714-4bff-af9f-b34cfd0a706a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:25.121053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc03dd-4714-4bff-af9f-b34cfd0a706a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:25.122373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 538/1099] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:25.127716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eefba5-7676-4bad-a046-86df004b5e0f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:25.128008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eefba5-7676-4bad-a046-86df004b5e0f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:25.128285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eefba5-7676-4bad-a046-86df004b5e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:25.147459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-18eefba5-7676-4bad-a046-86df004b5e0f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:25.148687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-18eefba5-7676-4bad-a046-86df004b5e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:25.217137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 562/1100] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:25.240783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc03dd-4714-4bff-af9f-b34cfd0a706a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:25.245360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:25.350206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc03dd-4714-4bff-af9f-b34cfd0a706a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:25.386193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:25.386736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:25.387012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:25.387273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:25.397824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:25.402724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:25.403881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:25.405278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 539/1101] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:25.409969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eefba5-7676-4bad-a046-86df004b5e0f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:25.490466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:25.511507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eefba5-7676-4bad-a046-86df004b5e0f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:25.545806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:25.546416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:25.546691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:25.546965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:25.547664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:25.547961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:25.549317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:25.559671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 563/1102] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:25.566027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:25.630696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:25.668776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47867977-6722-4ca8-9641-6aa8e2dcd70b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:25.702307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:25.702917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:25.703190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:25.703513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] PATH_INFO: `/v3/users/24b5635333a14a43ab1d33ba5d5e7ad2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:25.704610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] RBAC: Authorizing `identity:get_user(user_id=24b5635333a14a43ab1d33ba5d5e7ad2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:25.706024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:25.707589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 540/1103] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:25 2022] GET /identity/v3/users/24b5635333a14a43ab1d33ba5d5e7ad2 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:25.713579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:25.812496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914409-2075-41ca-8c3b-8df63d565046 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:25.844576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:25.845160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:25.845435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:25.845702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:25.857372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:25.914563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:25.916592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:26.014696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 564/1104] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 07:59:26.020553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:26.120067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94620c-30f8-42e6-bbe2-860b2e3592fc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:26.149027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:26.154824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212c4be-a536-478f-8017-152fc5ff78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:26.155465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212c4be-a536-478f-8017-152fc5ff78c2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:26.155750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212c4be-a536-478f-8017-152fc5ff78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:26.156031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212c4be-a536-478f-8017-152fc5ff78c2 None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:26.157139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212c4be-a536-478f-8017-152fc5ff78c2 None admin] RBAC: Authorizing `identity:get_project(project_id=83eae71c7cf14a7aac8a0f547aa12b2d)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:26.158566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212c4be-a536-478f-8017-152fc5ff78c2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:26.160185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 541/1105] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:26 2022] GET /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:26.166576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:26.209475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:26.265756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c660-bf0c-4216-b6b4-14f41be48caa None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:26.298437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ec4f0-da4d-45cf-b060-137dcedf34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:26.299036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ec4f0-da4d-45cf-b060-137dcedf34b8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:26.299308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ec4f0-da4d-45cf-b060-137dcedf34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:26.299605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ec4f0-da4d-45cf-b060-137dcedf34b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:26.300314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ec4f0-da4d-45cf-b060-137dcedf34b8 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d, user.id=24b5635333a14a43ab1d33ba5d5e7ad2) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:26.300614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ec4f0-da4d-45cf-b060-137dcedf34b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:26.302016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ec4f0-da4d-45cf-b060-137dcedf34b8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:26.308490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 565/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:26 2022] GET /identity/v3/role_assignments?user.id=24b5635333a14a43ab1d33ba5d5e7ad2&scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:28.322871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1d34-b4eb-4c97-910c-210b6d2287df None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:28.323337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1d34-b4eb-4c97-910c-210b6d2287df None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:28.323493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1d34-b4eb-4c97-910c-210b6d2287df None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:28.324727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 542/1107] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:28.329877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcdbe2-0164-45fa-aad1-ce6f3be769b5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:28.330292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcdbe2-0164-45fa-aad1-ce6f3be769b5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:28.330436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcdbe2-0164-45fa-aad1-ce6f3be769b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:28.348114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6bbcdbe2-0164-45fa-aad1-ce6f3be769b5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:28.349294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6bbcdbe2-0164-45fa-aad1-ce6f3be769b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:28.414732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 566/1108] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:28.440988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1d34-b4eb-4c97-910c-210b6d2287df None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:28.540281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1d34-b4eb-4c97-910c-210b6d2287df None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:28.573520 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9113958-4f56-4d7f-81a5-f02cf98d983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:28.574065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113958-4f56-4d7f-81a5-f02cf98d983a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:28.574346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113958-4f56-4d7f-81a5-f02cf98d983a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:28.574619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113958-4f56-4d7f-81a5-f02cf98d983a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:28.575747 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9113958-4f56-4d7f-81a5-f02cf98d983a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:28.577182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9113958-4f56-4d7f-81a5-f02cf98d983a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:28.578715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 543/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:28.584629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcdbe2-0164-45fa-aad1-ce6f3be769b5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:28.618401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:28.681794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcdbe2-0164-45fa-aad1-ce6f3be769b5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:28.714730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6a38d-8f46-4da0-bf33-018391dc767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:28.715362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6a38d-8f46-4da0-bf33-018391dc767b None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:28.715716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6a38d-8f46-4da0-bf33-018391dc767b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:28.716016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6a38d-8f46-4da0-bf33-018391dc767b None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:28.716704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6a38d-8f46-4da0-bf33-018391dc767b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:28.718278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6a38d-8f46-4da0-bf33-018391dc767b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:28.738144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 567/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:59:28 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:30.769448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f2f3-67f1-420c-b616-8e438611b89b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:30.769956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f2f3-67f1-420c-b616-8e438611b89b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:30.769956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f2f3-67f1-420c-b616-8e438611b89b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:30.771221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 544/1111] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:30.777113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3cb6-1aa0-417b-b8e8-6bc0657f5ff8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:30.777540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3cb6-1aa0-417b-b8e8-6bc0657f5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:30.777659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3cb6-1aa0-417b-b8e8-6bc0657f5ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:30.795824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f48c3cb6-1aa0-417b-b8e8-6bc0657f5ff8 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:30.796992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f48c3cb6-1aa0-417b-b8e8-6bc0657f5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:30.860851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 568/1112] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:30.885780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97f2f3-67f1-420c-b616-8e438611b89b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:30.953130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:30.986893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97f2f3-67f1-420c-b616-8e438611b89b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:31.021839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:31.022433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:31.022769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:31.023040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] PATH_INFO: `/v3/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:31.025147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] RBAC: Authorizing `identity:get_role(role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:31.026738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:31.028260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 545/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:30 2022] GET /identity/v3/roles/d4924cc22b334ebe9f07b5938e64913b => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:31.034355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c3cb6-1aa0-417b-b8e8-6bc0657f5ff8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:31.057831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:31.132483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c3cb6-1aa0-417b-b8e8-6bc0657f5ff8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:31.165745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:31.166365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:31.166646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:31.166917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] PATH_INFO: `/v3/users/685152492db14a199e946ae346b67e07` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:31.179307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] RBAC: Authorizing `identity:get_user(user_id=685152492db14a199e946ae346b67e07)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:31.180812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:31.182644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 569/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:31 2022] GET /identity/v3/users/685152492db14a199e946ae346b67e07 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:31.188536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:31.292866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533d4b-b445-4b00-b2ce-45e3142170e9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:31.328909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:31.329533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:31.329806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:31.330071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:31.333391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:31.397600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:31.399103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:31.501370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 546/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:31.507486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:31.593523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:31.612411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbbe1e-be21-45d6-bba7-a0e3fdec9179 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:31.647721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afff5a-e12b-498d-958f-54e9695b5a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:31.648409 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afff5a-e12b-498d-958f-54e9695b5a59 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:31.648686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afff5a-e12b-498d-958f-54e9695b5a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:31.648987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afff5a-e12b-498d-958f-54e9695b5a59 None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:31.650320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afff5a-e12b-498d-958f-54e9695b5a59 None admin] RBAC: Authorizing `identity:get_project(project_id=83eae71c7cf14a7aac8a0f547aa12b2d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:31.651843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afff5a-e12b-498d-958f-54e9695b5a59 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:31.653526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 570/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:31 2022] GET /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:31.659684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:31.698351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:31.764574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7511bb-5ba9-4542-9172-457fdce9fcbe None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:31.798124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e8f44-edba-4586-b1dd-c0118d8ef5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:31.798769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e8f44-edba-4586-b1dd-c0118d8ef5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:31.799082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e8f44-edba-4586-b1dd-c0118d8ef5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:31.799388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e8f44-edba-4586-b1dd-c0118d8ef5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:31.800170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e8f44-edba-4586-b1dd-c0118d8ef5a2 None admin] RBAC: Adding query filter params (role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d, user.id=685152492db14a199e946ae346b67e07) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:31.800472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e8f44-edba-4586-b1dd-c0118d8ef5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:31.802066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e8f44-edba-4586-b1dd-c0118d8ef5a2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:31.808318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 547/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:31 2022] GET /identity/v3/role_assignments?user.id=685152492db14a199e946ae346b67e07&scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:33.769367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d89d8a-1afc-4e20-9464-801834d22627 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:33.769899 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d89d8a-1afc-4e20-9464-801834d22627 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:33.770009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d89d8a-1afc-4e20-9464-801834d22627 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:33.771407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 571/1118] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:33.777255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5f9fb-a0af-475d-89ef-95bfb782ee7b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:33.777648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5f9fb-a0af-475d-89ef-95bfb782ee7b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:33.777797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5f9fb-a0af-475d-89ef-95bfb782ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:33.795899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d5d5f9fb-a0af-475d-89ef-95bfb782ee7b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:33.797072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d5d5f9fb-a0af-475d-89ef-95bfb782ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:33.862022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 548/1119] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:33.883891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d89d8a-1afc-4e20-9464-801834d22627 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:33.990647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d89d8a-1afc-4e20-9464-801834d22627 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:34.026515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:34.027145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:34.027444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:34.027724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] PATH_INFO: `/v3/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:34.029094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] RBAC: Authorizing `identity:get_role(role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:34.030554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:34.031981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 572/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:33 2022] GET /identity/v3/roles/d4924cc22b334ebe9f07b5938e64913b => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:34.037971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5f9fb-a0af-475d-89ef-95bfb782ee7b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:34.067082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:34.136725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5f9fb-a0af-475d-89ef-95bfb782ee7b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:34.170170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:34.170785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:34.171062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:34.171332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] PATH_INFO: `/v3/users/685152492db14a199e946ae346b67e07` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:34.172470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] RBAC: Authorizing `identity:get_user(user_id=685152492db14a199e946ae346b67e07)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:34.173905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:34.175490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 549/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:34 2022] GET /identity/v3/users/685152492db14a199e946ae346b67e07 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:34.182035 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:34.200547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:34.279435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a59eb-251c-41c7-97c4-918a01fee7e2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:34.316318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34521c-0254-404a-a535-cc3c1070f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:34.316940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34521c-0254-404a-a535-cc3c1070f362 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:34.317219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34521c-0254-404a-a535-cc3c1070f362 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:34.317490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34521c-0254-404a-a535-cc3c1070f362 None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:34.318594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34521c-0254-404a-a535-cc3c1070f362 None admin] RBAC: Authorizing `identity:get_project(project_id=83eae71c7cf14a7aac8a0f547aa12b2d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:34.320056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34521c-0254-404a-a535-cc3c1070f362 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:34.321764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 573/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:34 2022] GET /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:34.328026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:34.423341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:34.427162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ffec-62d0-44ae-9877-9bbad95bc89a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:34.461619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd81fd-59df-4916-bed5-747d29ef357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:34.462885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd81fd-59df-4916-bed5-747d29ef357c None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:34.463155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd81fd-59df-4916-bed5-747d29ef357c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:34.463443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd81fd-59df-4916-bed5-747d29ef357c None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d/users/685152492db14a199e946ae346b67e07/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:34.465566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd81fd-59df-4916-bed5-747d29ef357c None admin] RBAC: Authorizing `identity:create_grant(project_id=83eae71c7cf14a7aac8a0f547aa12b2d, user_id=685152492db14a199e946ae346b67e07, role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:34.466983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd81fd-59df-4916-bed5-747d29ef357c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:34.480166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 550/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:59:34 2022] PUT /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d/users/685152492db14a199e946ae346b67e07/roles/d4924cc22b334ebe9f07b5938e64913b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:59:36.454870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071916a-d459-4863-82e9-9f74ec0d98ec None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:36.455439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071916a-d459-4863-82e9-9f74ec0d98ec None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:36.455439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071916a-d459-4863-82e9-9f74ec0d98ec None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:36.456766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 574/1124] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:36.461705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f4efe-caec-44b2-9608-b1754ed94970 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:36.462680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f4efe-caec-44b2-9608-b1754ed94970 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:36.462958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f4efe-caec-44b2-9608-b1754ed94970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:36.480373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e06f4efe-caec-44b2-9608-b1754ed94970 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:36.481567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e06f4efe-caec-44b2-9608-b1754ed94970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:36.547571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 551/1125] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:36.570528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071916a-d459-4863-82e9-9f74ec0d98ec None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:36.657229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:36.674482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071916a-d459-4863-82e9-9f74ec0d98ec None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:36.708594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:36.709204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:36.709478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:36.709744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] PATH_INFO: `/v3/roles/d4924cc22b334ebe9f07b5938e64913b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:36.711100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] RBAC: Authorizing `identity:get_role(role_id=d4924cc22b334ebe9f07b5938e64913b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:36.713041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:36.714726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 575/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:36 2022] GET /identity/v3/roles/d4924cc22b334ebe9f07b5938e64913b => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:36.720711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f4efe-caec-44b2-9608-b1754ed94970 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:36.812536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:36.826207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f4efe-caec-44b2-9608-b1754ed94970 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:36.858672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:36.859288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:36.859603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:36.859875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] PATH_INFO: `/v3/users/685152492db14a199e946ae346b67e07` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:36.861010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] RBAC: Authorizing `identity:get_user(user_id=685152492db14a199e946ae346b67e07)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:36.862433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:36.864147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 552/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:36 2022] GET /identity/v3/users/685152492db14a199e946ae346b67e07 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:36.870587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:36.970014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ec3e-32f8-4f6f-97d7-d96a33dc709e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:37.004678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:37.005341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:37.005632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:37.005919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:37.027544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:37.072646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:37.074093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:37.169449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 576/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:37.175151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:37.273183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb615a-7d46-4677-aac7-491fdbdffdb2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:37.307574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2960d-87f7-44ab-b44a-8f056f7a72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:37.308199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2960d-87f7-44ab-b44a-8f056f7a72eb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:37.308478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2960d-87f7-44ab-b44a-8f056f7a72eb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:37.308749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2960d-87f7-44ab-b44a-8f056f7a72eb None admin] PATH_INFO: `/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:37.309865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2960d-87f7-44ab-b44a-8f056f7a72eb None admin] RBAC: Authorizing `identity:get_project(project_id=83eae71c7cf14a7aac8a0f547aa12b2d)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:37.311290 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2960d-87f7-44ab-b44a-8f056f7a72eb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:37.312931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 553/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:37 2022] GET /identity/v3/projects/83eae71c7cf14a7aac8a0f547aa12b2d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:37.319008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:37.369410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:37.414551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044abe3-5099-4884-a37c-dee231f5d67f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:37.448294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1a0e-3c03-4022-b81a-9145a88da2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:37.448818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1a0e-3c03-4022-b81a-9145a88da2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:37.449090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1a0e-3c03-4022-b81a-9145a88da2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:37.449357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1a0e-3c03-4022-b81a-9145a88da2a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:37.450065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1a0e-3c03-4022-b81a-9145a88da2a0 None admin] RBAC: Adding query filter params (role.id=d4924cc22b334ebe9f07b5938e64913b, scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d, user.id=685152492db14a199e946ae346b67e07) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:37.450365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1a0e-3c03-4022-b81a-9145a88da2a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:37.451807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1a0e-3c03-4022-b81a-9145a88da2a0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:37.457288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 577/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:37 2022] GET /identity/v3/role_assignments?user.id=685152492db14a199e946ae346b67e07&scope.project.id=83eae71c7cf14a7aac8a0f547aa12b2d&role.id=d4924cc22b334ebe9f07b5938e64913b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:39.538234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2e4c-77ff-44fc-8f31-6ddf37844556 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:39.538793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2e4c-77ff-44fc-8f31-6ddf37844556 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:39.538793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2e4c-77ff-44fc-8f31-6ddf37844556 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:39.540320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 554/1131] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:39.545780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8876-7306-48a3-835a-3f46007e1e73 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:39.546188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8876-7306-48a3-835a-3f46007e1e73 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:39.546343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8876-7306-48a3-835a-3f46007e1e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:39.565172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9f9c8876-7306-48a3-835a-3f46007e1e73 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:39.566343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9f9c8876-7306-48a3-835a-3f46007e1e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:39.634552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 578/1132] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:39.657212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2e4c-77ff-44fc-8f31-6ddf37844556 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:39.682280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:39.757126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2e4c-77ff-44fc-8f31-6ddf37844556 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:39.790221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3235f7-4155-4e7d-91a0-bf790e3464eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:39.790830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3235f7-4155-4e7d-91a0-bf790e3464eb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:39.791106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3235f7-4155-4e7d-91a0-bf790e3464eb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:39.791374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3235f7-4155-4e7d-91a0-bf790e3464eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:39.792509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3235f7-4155-4e7d-91a0-bf790e3464eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:39.793932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3235f7-4155-4e7d-91a0-bf790e3464eb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:39.795506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 555/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:39.801288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8876-7306-48a3-835a-3f46007e1e73 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:39.847804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:39.899948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8876-7306-48a3-835a-3f46007e1e73 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:39.932900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6b4e-a9e9-45c2-957b-a08144cb1361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:39.933507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6b4e-a9e9-45c2-957b-a08144cb1361 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:39.933782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6b4e-a9e9-45c2-957b-a08144cb1361 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:39.934053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6b4e-a9e9-45c2-957b-a08144cb1361 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:39.934701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d6b4e-a9e9-45c2-957b-a08144cb1361 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:39.936151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d6b4e-a9e9-45c2-957b-a08144cb1361 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:39.964300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 579/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:59:39 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:42.007365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264aee-47d8-41c4-92fd-4b69381b92f6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:42.007919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264aee-47d8-41c4-92fd-4b69381b92f6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:42.007919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264aee-47d8-41c4-92fd-4b69381b92f6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:42.009284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 556/1135] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:42.014501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86286d66-d016-45e8-af4a-23014888ea6c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:42.014936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86286d66-d016-45e8-af4a-23014888ea6c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:42.015043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86286d66-d016-45e8-af4a-23014888ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:42.034634 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-86286d66-d016-45e8-af4a-23014888ea6c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:42.035851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-86286d66-d016-45e8-af4a-23014888ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:42.100749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 580/1136] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:42.126334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99264aee-47d8-41c4-92fd-4b69381b92f6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:42.231668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:42.241459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99264aee-47d8-41c4-92fd-4b69381b92f6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:42.277713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9df775-4dc6-4d03-996d-6b6519bb8325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:42.278264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df775-4dc6-4d03-996d-6b6519bb8325 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:42.278539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df775-4dc6-4d03-996d-6b6519bb8325 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:42.278807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df775-4dc6-4d03-996d-6b6519bb8325 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:42.279936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9df775-4dc6-4d03-996d-6b6519bb8325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:42.281363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9df775-4dc6-4d03-996d-6b6519bb8325 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:42.282897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 557/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 07:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:42.288756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86286d66-d016-45e8-af4a-23014888ea6c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:42.318830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:42.391092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86286d66-d016-45e8-af4a-23014888ea6c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:42.424561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396f7f-a0ee-4f44-8fc1-75b74f2377ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:42.425222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396f7f-a0ee-4f44-8fc1-75b74f2377ba None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:42.425497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396f7f-a0ee-4f44-8fc1-75b74f2377ba None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:42.425765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396f7f-a0ee-4f44-8fc1-75b74f2377ba None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:42.426438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae396f7f-a0ee-4f44-8fc1-75b74f2377ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:42.428099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae396f7f-a0ee-4f44-8fc1-75b74f2377ba None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:42.449551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 581/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 07:59:42 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 07:59:44.479156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624512c7-759d-4d9a-8231-cac8f4fc24c0 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:44.479788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624512c7-759d-4d9a-8231-cac8f4fc24c0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:44.479788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624512c7-759d-4d9a-8231-cac8f4fc24c0 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:44.481068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 558/1139] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:44.486068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c761a1-c398-4f6d-b3a2-aab25c2b8372 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:44.486459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c761a1-c398-4f6d-b3a2-aab25c2b8372 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:44.486609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c761a1-c398-4f6d-b3a2-aab25c2b8372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:44.504592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-76c761a1-c398-4f6d-b3a2-aab25c2b8372 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:44.505765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-76c761a1-c398-4f6d-b3a2-aab25c2b8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:44.572461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 582/1140] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:44.598324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624512c7-759d-4d9a-8231-cac8f4fc24c0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:44.698937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624512c7-759d-4d9a-8231-cac8f4fc24c0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:44.732458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:44.733064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:44.733339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:44.733604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:44.744106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:44.748726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:44.749940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:44.751158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 559/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:44.755846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c761a1-c398-4f6d-b3a2-aab25c2b8372 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:44.770156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:44.850663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c761a1-c398-4f6d-b3a2-aab25c2b8372 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:44.883762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:44.884353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:44.884626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:44.884893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:44.885590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:44.885888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:44.887230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:44.895118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 583/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:44.901359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:44.923267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:45.003093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed4dca-f345-41d8-979b-542cd78ab496 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:45.038318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:45.038999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:45.039321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:45.040237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] PATH_INFO: `/v3/users/871c2055656f4859b00450b5ea4545b7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:45.053025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] RBAC: Authorizing `identity:get_user(user_id=871c2055656f4859b00450b5ea4545b7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:45.054453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:45.056468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 560/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:44 2022] GET /identity/v3/users/871c2055656f4859b00450b5ea4545b7 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:45.062237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:45.137383 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:45.160184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ad26c-d811-4599-b4af-ac0e285450bd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:45.192893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:45.193487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:45.193764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:45.194036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:45.261352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:45.262788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:45.335469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:45.359484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 584/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:45.365717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:45.442143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:45.464618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c063-b194-4b79-b376-e96082194be0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:45.496822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dcc59-532f-4d66-9270-1a1a619afe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:45.497444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcc59-532f-4d66-9270-1a1a619afe24 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:45.497718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcc59-532f-4d66-9270-1a1a619afe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:45.497989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcc59-532f-4d66-9270-1a1a619afe24 None admin] PATH_INFO: `/v3/projects/979f73716b804a3b9a56d81000e7d8da` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:45.499081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcc59-532f-4d66-9270-1a1a619afe24 None admin] RBAC: Authorizing `identity:get_project(project_id=979f73716b804a3b9a56d81000e7d8da)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:45.500546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcc59-532f-4d66-9270-1a1a619afe24 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:45.502138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 561/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:45 2022] GET /identity/v3/projects/979f73716b804a3b9a56d81000e7d8da => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:45.508745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:45.604186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05306b89-baf6-4656-a81a-d5e6b88bba48 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:45.637498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bae0a-5290-416d-b90e-0d8e31028cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:45.638085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bae0a-5290-416d-b90e-0d8e31028cdf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:45.638362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bae0a-5290-416d-b90e-0d8e31028cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:45.638645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bae0a-5290-416d-b90e-0d8e31028cdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:45.639341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bae0a-5290-416d-b90e-0d8e31028cdf None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=979f73716b804a3b9a56d81000e7d8da, user.id=871c2055656f4859b00450b5ea4545b7) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:45.639672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bae0a-5290-416d-b90e-0d8e31028cdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:45.641078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bae0a-5290-416d-b90e-0d8e31028cdf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:45.646307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 585/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:45 2022] GET /identity/v3/role_assignments?user.id=871c2055656f4859b00450b5ea4545b7&scope.project.id=979f73716b804a3b9a56d81000e7d8da&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:47.607459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8cd9-d2f3-42a8-92b8-4744697f855b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:47.608043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8cd9-d2f3-42a8-92b8-4744697f855b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:47.608043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8cd9-d2f3-42a8-92b8-4744697f855b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:47.609460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 562/1147] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:47.615131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daaeba-ec9b-4e24-93ce-687beb63022a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:47.615621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daaeba-ec9b-4e24-93ce-687beb63022a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:47.615771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daaeba-ec9b-4e24-93ce-687beb63022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:47.636433 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-30daaeba-ec9b-4e24-93ce-687beb63022a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:47.637787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-30daaeba-ec9b-4e24-93ce-687beb63022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:47.672756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:47.706118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 586/1148] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:47.728944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8cd9-d2f3-42a8-92b8-4744697f855b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:47.827696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8cd9-d2f3-42a8-92b8-4744697f855b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:47.860927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:47.861475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:47.861752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:47.862022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:47.872482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:47.877119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:47.878263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:47.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 563/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:47.884884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daaeba-ec9b-4e24-93ce-687beb63022a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:47.980324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daaeba-ec9b-4e24-93ce-687beb63022a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:48.013814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:48.014413 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:48.014688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:48.014960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:48.015640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:48.015938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:48.017285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:48.025009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 587/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:48.030894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:48.040254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:48.131636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb88ab-63a2-49b1-b30c-503b43999768 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:48.167384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:48.168086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:48.168396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:48.168665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] PATH_INFO: `/v3/users/871c2055656f4859b00450b5ea4545b7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:48.169853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] RBAC: Authorizing `identity:get_user(user_id=871c2055656f4859b00450b5ea4545b7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:48.171271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:48.172862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 564/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:48 2022] GET /identity/v3/users/871c2055656f4859b00450b5ea4545b7 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:48.178641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:48.210868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:48.277135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72fdd-0604-4f21-a2ec-865fb5e6c9ab None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:48.310533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f81a6-4baf-4a9d-9b8b-5cdd531b82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:48.311157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f81a6-4baf-4a9d-9b8b-5cdd531b82f8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:48.311452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f81a6-4baf-4a9d-9b8b-5cdd531b82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:48.311724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f81a6-4baf-4a9d-9b8b-5cdd531b82f8 None admin] PATH_INFO: `/v3/projects/979f73716b804a3b9a56d81000e7d8da` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:48.312816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f81a6-4baf-4a9d-9b8b-5cdd531b82f8 None admin] RBAC: Authorizing `identity:get_project(project_id=979f73716b804a3b9a56d81000e7d8da)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:48.314230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f81a6-4baf-4a9d-9b8b-5cdd531b82f8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:48.315888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 588/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:48 2022] GET /identity/v3/projects/979f73716b804a3b9a56d81000e7d8da => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:48.321860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:48.395966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:48.422664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c742c-97cc-400a-a568-4a7ed959317f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:48.458859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2a622-c3a0-47d4-a302-0b190d5125e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:48.459573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2a622-c3a0-47d4-a302-0b190d5125e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:48.459871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2a622-c3a0-47d4-a302-0b190d5125e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:48.460143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2a622-c3a0-47d4-a302-0b190d5125e3 None admin] PATH_INFO: `/v3/projects/979f73716b804a3b9a56d81000e7d8da/users/871c2055656f4859b00450b5ea4545b7/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:48.462244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2a622-c3a0-47d4-a302-0b190d5125e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=979f73716b804a3b9a56d81000e7d8da, user_id=871c2055656f4859b00450b5ea4545b7, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:48.463777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2a622-c3a0-47d4-a302-0b190d5125e3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:48.476027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 565/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 07:59:48 2022] PUT /identity/v3/projects/979f73716b804a3b9a56d81000e7d8da/users/871c2055656f4859b00450b5ea4545b7/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 07:59:50.551697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e8b4c-3a10-4015-9893-7f4f54c6a41a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:50.552288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e8b4c-3a10-4015-9893-7f4f54c6a41a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:50.552288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e8b4c-3a10-4015-9893-7f4f54c6a41a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:50.553621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 589/1154] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:50.560076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ea05e-a430-4397-927a-112a794082e2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:50.560512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ea05e-a430-4397-927a-112a794082e2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:50.560609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ea05e-a430-4397-927a-112a794082e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:50.578819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c71ea05e-a430-4397-927a-112a794082e2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:50.580161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c71ea05e-a430-4397-927a-112a794082e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:50.648061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 566/1155] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:50.673198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e8b4c-3a10-4015-9893-7f4f54c6a41a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:50.769610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:50.773818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e8b4c-3a10-4015-9893-7f4f54c6a41a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:50.807799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:50.808348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:50.808621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:50.808886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:50.818541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 07:59:50.823321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:50.824605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 07:59:50.825957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 590/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 07:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:50.830594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ea05e-a430-4397-927a-112a794082e2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:50.892036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:50.930171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ea05e-a430-4397-927a-112a794082e2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:50.965430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:50.966012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:50.966285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:50.966550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:50.967200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:50.967519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:50.968872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:50.979246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 567/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 07:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 07:59:50.985127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:51.083337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39a11-22a6-4e52-96a5-20237ad8dc26 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:51.116534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:51.117143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:51.117444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:51.117709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] PATH_INFO: `/v3/users/871c2055656f4859b00450b5ea4545b7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:51.118802 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] RBAC: Authorizing `identity:get_user(user_id=871c2055656f4859b00450b5ea4545b7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:51.120242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:51.121787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 591/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 07:59:50 2022] GET /identity/v3/users/871c2055656f4859b00450b5ea4545b7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:51.127769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:51.226242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b623d-3a46-4899-96a4-aa2e146a09fe None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:51.251012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:51.260604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:51.261196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:51.261476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:51.261748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:51.329731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:51.331187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:51.427126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 568/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:51.433167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:51.460924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:51.530586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ea2f-2331-4b50-9ffa-d5addbdb9546 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:51.562092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04c650-14ad-48d1-8401-4bc8f9b75d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:51.562710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04c650-14ad-48d1-8401-4bc8f9b75d93 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:51.562982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04c650-14ad-48d1-8401-4bc8f9b75d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:51.563248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04c650-14ad-48d1-8401-4bc8f9b75d93 None admin] PATH_INFO: `/v3/projects/979f73716b804a3b9a56d81000e7d8da` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:51.564353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04c650-14ad-48d1-8401-4bc8f9b75d93 None admin] RBAC: Authorizing `identity:get_project(project_id=979f73716b804a3b9a56d81000e7d8da)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:51.565757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04c650-14ad-48d1-8401-4bc8f9b75d93 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:51.567344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 592/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 07:59:51 2022] GET /identity/v3/projects/979f73716b804a3b9a56d81000e7d8da => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:51.574416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:51.602868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:51.677300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c02b63-768f-4a55-906d-2fc23c5a6940 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:51.711056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd733c4-4522-4118-8f7c-d2d2d6dcb0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:51.711666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd733c4-4522-4118-8f7c-d2d2d6dcb0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:51.711939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd733c4-4522-4118-8f7c-d2d2d6dcb0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:51.712203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd733c4-4522-4118-8f7c-d2d2d6dcb0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:51.712906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd733c4-4522-4118-8f7c-d2d2d6dcb0e9 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=979f73716b804a3b9a56d81000e7d8da, user.id=871c2055656f4859b00450b5ea4545b7) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:51.713204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd733c4-4522-4118-8f7c-d2d2d6dcb0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:51.714704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd733c4-4522-4118-8f7c-d2d2d6dcb0e9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:51.720502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 569/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 07:59:51 2022] GET /identity/v3/role_assignments?user.id=871c2055656f4859b00450b5ea4545b7&scope.project.id=979f73716b804a3b9a56d81000e7d8da&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:53.806633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2fcd9-69b6-46b2-a74c-6cdf81bea976 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:53.807193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2fcd9-69b6-46b2-a74c-6cdf81bea976 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:53.807193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2fcd9-69b6-46b2-a74c-6cdf81bea976 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:53.808530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 593/1162] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:53.813665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911583-4f1e-4edb-9f87-16be9a0b08c2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:53.814133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911583-4f1e-4edb-9f87-16be9a0b08c2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:53.814255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911583-4f1e-4edb-9f87-16be9a0b08c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:53.833062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-59911583-4f1e-4edb-9f87-16be9a0b08c2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:53.834232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-59911583-4f1e-4edb-9f87-16be9a0b08c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:53.899261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 570/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:53.920790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2fcd9-69b6-46b2-a74c-6cdf81bea976 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:54.015955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:54.022784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2fcd9-69b6-46b2-a74c-6cdf81bea976 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:54.055556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:54.056407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:54.056733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:54.056950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:54.120709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:54.122144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:54.209879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:54.216916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 594/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 07:59:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 07:59:54.222838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911583-4f1e-4edb-9f87-16be9a0b08c2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:54.243765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:54.321109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911583-4f1e-4edb-9f87-16be9a0b08c2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:54.353712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae07f96-1f19-493a-9c6b-dcd033cc9122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:54.354333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae07f96-1f19-493a-9c6b-dcd033cc9122 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:54.354614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae07f96-1f19-493a-9c6b-dcd033cc9122 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:54.354885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae07f96-1f19-493a-9c6b-dcd033cc9122 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:54.361452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae07f96-1f19-493a-9c6b-dcd033cc9122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:54.362881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae07f96-1f19-493a-9c6b-dcd033cc9122 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3ae07f96-1f19-493a-9c6b-dcd033cc9122 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 07:59:54.374570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 07:59:54.375881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 07:59:54.376899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 571/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 07:59:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 07:59:54.381765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:54.484493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a18ec5-011b-4c25-8fd5-8944346a47ad None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:54.517831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da532f4-e19d-46f6-b4d6-09bfa1b15e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:54.518422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da532f4-e19d-46f6-b4d6-09bfa1b15e11 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:54.518695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da532f4-e19d-46f6-b4d6-09bfa1b15e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:54.519005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da532f4-e19d-46f6-b4d6-09bfa1b15e11 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:54.519739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da532f4-e19d-46f6-b4d6-09bfa1b15e11 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 07:59:54.520075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da532f4-e19d-46f6-b4d6-09bfa1b15e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:54.521604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da532f4-e19d-46f6-b4d6-09bfa1b15e11 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:54.528931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 595/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 07:59:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:56.522437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ca9ba-7a38-4692-9bd8-819a49b63149 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:56.522964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ca9ba-7a38-4692-9bd8-819a49b63149 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:56.522964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ca9ba-7a38-4692-9bd8-819a49b63149 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:56.525003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 572/1167] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:56.530355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4e486-5508-4847-b44c-8656d342ce3e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:56.530775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4e486-5508-4847-b44c-8656d342ce3e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:56.530884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4e486-5508-4847-b44c-8656d342ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:56.549173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7ac4e486-5508-4847-b44c-8656d342ce3e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:56.550346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7ac4e486-5508-4847-b44c-8656d342ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:56.604127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:56.615161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 596/1168] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 07:59:56.637750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ca9ba-7a38-4692-9bd8-819a49b63149 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:56.716826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:56.736504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ca9ba-7a38-4692-9bd8-819a49b63149 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:56.768804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e689ba6-3ee1-46b3-aa5f-2b29b80f2e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:56.769386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689ba6-3ee1-46b3-aa5f-2b29b80f2e5a None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:56.769658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689ba6-3ee1-46b3-aa5f-2b29b80f2e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:56.769925 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689ba6-3ee1-46b3-aa5f-2b29b80f2e5a None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:56.770563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e689ba6-3ee1-46b3-aa5f-2b29b80f2e5a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:56.771949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e689ba6-3ee1-46b3-aa5f-2b29b80f2e5a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:56.787275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 573/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Wed Aug 10 07:59:56 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 07:59:58.988460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1dc9-3c7d-4d11-b4fa-3cbfbed86e98 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:58.989030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1dc9-3c7d-4d11-b4fa-3cbfbed86e98 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:58.989030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1dc9-3c7d-4d11-b4fa-3cbfbed86e98 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:58.990417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 597/1170] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 07:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 07:59:58.995669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac864dc3-792d-4498-ba16-945771320623 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:58.996076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac864dc3-792d-4498-ba16-945771320623 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:58.996220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac864dc3-792d-4498-ba16-945771320623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:59.014304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ac864dc3-792d-4498-ba16-945771320623 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 07:59:59.015518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ac864dc3-792d-4498-ba16-945771320623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 07:59:59.080433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 574/1171] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 07:59:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 07:59:59.104093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1dc9-3c7d-4d11-b4fa-3cbfbed86e98 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:59.204368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1dc9-3c7d-4d11-b4fa-3cbfbed86e98 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:59.238145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b1fc2-0721-4010-82a5-6b620ebc9417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:59.238844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b1fc2-0721-4010-82a5-6b620ebc9417 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:59.239099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b1fc2-0721-4010-82a5-6b620ebc9417 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:59.239404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b1fc2-0721-4010-82a5-6b620ebc9417 None admin] PATH_INFO: `/v3/domains/c8d9aae12a754793b4ba6298d0239eaf` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:59.250262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b1fc2-0721-4010-82a5-6b620ebc9417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8d9aae12a754793b4ba6298d0239eaf)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:59.251740 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b1fc2-0721-4010-82a5-6b620ebc9417 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:59.253455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 598/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 10 07:59:59 2022] GET /identity/v3/domains/c8d9aae12a754793b4ba6298d0239eaf => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 07:59:59.259903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac864dc3-792d-4498-ba16-945771320623 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 07:59:59.327868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 07:59:59.358806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac864dc3-792d-4498-ba16-945771320623 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 07:59:59.392186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2d80e-2385-42de-a06e-12f5a70571bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 07:59:59.392782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2d80e-2385-42de-a06e-12f5a70571bb None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 07:59:59.393060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2d80e-2385-42de-a06e-12f5a70571bb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 07:59:59.393330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2d80e-2385-42de-a06e-12f5a70571bb None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 07:59:59.393975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2d80e-2385-42de-a06e-12f5a70571bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 07:59:59.395401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2d80e-2385-42de-a06e-12f5a70571bb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 07:59:59.420396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 575/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 07:59:59 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:00:01.487090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8675e7-6eb9-41ef-a88f-0812dc5832b0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:01.487655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8675e7-6eb9-41ef-a88f-0812dc5832b0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:01.487655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8675e7-6eb9-41ef-a88f-0812dc5832b0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:01.489003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 599/1174] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:00:01.494141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f8f8-8e43-48b5-82d5-b0570a70ce25 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:01.494568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f8f8-8e43-48b5-82d5-b0570a70ce25 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:01.494687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f8f8-8e43-48b5-82d5-b0570a70ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:01.512146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a4c5f8f8-8e43-48b5-82d5-b0570a70ce25 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:00:01.513304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a4c5f8f8-8e43-48b5-82d5-b0570a70ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:00:01.578469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 576/1175] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:00:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:00:01.603523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8675e7-6eb9-41ef-a88f-0812dc5832b0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:01.652769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:01.702575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8675e7-6eb9-41ef-a88f-0812dc5832b0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:01.735874 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a6178-c0b2-483d-864f-c3ff9097d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:01.736485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6178-c0b2-483d-864f-c3ff9097d363 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:01.736758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6178-c0b2-483d-864f-c3ff9097d363 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:01.737021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6178-c0b2-483d-864f-c3ff9097d363 None admin] PATH_INFO: `/v3/domains/c8d9aae12a754793b4ba6298d0239eaf` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:01.738092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a6178-c0b2-483d-864f-c3ff9097d363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8d9aae12a754793b4ba6298d0239eaf)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:01.739515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a6178-c0b2-483d-864f-c3ff9097d363 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:01.741050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 600/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 10 08:00:01 2022] GET /identity/v3/domains/c8d9aae12a754793b4ba6298d0239eaf => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:01.746820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5f8f8-8e43-48b5-82d5-b0570a70ce25 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:01.796738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:01.843355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5f8f8-8e43-48b5-82d5-b0570a70ce25 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:01.875762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d275d4-bf79-4889-8de8-7ce3fd05693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:01.876351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d275d4-bf79-4889-8de8-7ce3fd05693c None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:01.876625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d275d4-bf79-4889-8de8-7ce3fd05693c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:01.876894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d275d4-bf79-4889-8de8-7ce3fd05693c None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:01.877543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d275d4-bf79-4889-8de8-7ce3fd05693c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:01.878963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d275d4-bf79-4889-8de8-7ce3fd05693c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:01.900992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 577/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 08:00:01 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:00:03.932103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638323f-e832-4db5-98d6-32adab278ed7 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:03.932707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638323f-e832-4db5-98d6-32adab278ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:03.932707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638323f-e832-4db5-98d6-32adab278ed7 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:03.933953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 601/1178] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:00:03.938981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84bc5-0d7e-48f0-9564-b097d4b93c84 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:03.939454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84bc5-0d7e-48f0-9564-b097d4b93c84 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:03.939569 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84bc5-0d7e-48f0-9564-b097d4b93c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:03.958429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-dea84bc5-0d7e-48f0-9564-b097d4b93c84 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:00:03.959643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dea84bc5-0d7e-48f0-9564-b097d4b93c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:00:04.024154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 578/1179] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:00:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:00:04.047273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638323f-e832-4db5-98d6-32adab278ed7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:04.146600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638323f-e832-4db5-98d6-32adab278ed7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:04.163773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:04.181085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:04.181702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:04.181980 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:04.182302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:04.192042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:00:04.197302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:00:04.198520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:00:04.199698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 602/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 08:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:00:04.204361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea84bc5-0d7e-48f0-9564-b097d4b93c84 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:04.243345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:04.303089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea84bc5-0d7e-48f0-9564-b097d4b93c84 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:04.337241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:04.337837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:04.338112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:04.338378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:04.339031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:00:04.339328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:04.340713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:04.348421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 579/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 08:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:04.354553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:04.453148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac06c-4961-4e52-b959-95f6e2811059 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:04.485251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:04.485861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:04.486157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:04.486443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] PATH_INFO: `/v3/users/48cd66b0407f4d358720ae2bc0c0ae61` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:04.500178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] RBAC: Authorizing `identity:get_user(user_id=48cd66b0407f4d358720ae2bc0c0ae61)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:04.501621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:04.503192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 603/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 08:00:04 2022] GET /identity/v3/users/48cd66b0407f4d358720ae2bc0c0ae61 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:04.509467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:04.603004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:04.606254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a850-ddb8-4f95-843c-e1fd1ca92f17 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:04.639905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:04.640494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:04.640769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:04.641039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:04.706108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:04.707501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:04.798650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:04.802286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 580/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 08:00:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:00:04.809317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:04.842990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:04.905259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10af1-5fbf-4695-a6c8-8fecd0904baf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:04.938328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2321-b529-4fb2-bc54-34675832869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:04.938918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2321-b529-4fb2-bc54-34675832869a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:04.939195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2321-b529-4fb2-bc54-34675832869a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:04.939482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2321-b529-4fb2-bc54-34675832869a None admin] PATH_INFO: `/v3/projects/692b9d91e3344e0ca776eb902747ca41` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:04.940565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2321-b529-4fb2-bc54-34675832869a None admin] RBAC: Authorizing `identity:get_project(project_id=692b9d91e3344e0ca776eb902747ca41)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:04.941970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2321-b529-4fb2-bc54-34675832869a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:04.943585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 604/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 08:00:04 2022] GET /identity/v3/projects/692b9d91e3344e0ca776eb902747ca41 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:04.949656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:05.046648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99ee49-9600-444c-b660-7aa1679b2320 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:05.079578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14c168-00c0-481f-ac69-eb005586ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:05.080162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c168-00c0-481f-ac69-eb005586ce91 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:05.080435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c168-00c0-481f-ac69-eb005586ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:05.080701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c168-00c0-481f-ac69-eb005586ce91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:05.081400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14c168-00c0-481f-ac69-eb005586ce91 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=692b9d91e3344e0ca776eb902747ca41, user.id=48cd66b0407f4d358720ae2bc0c0ae61) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:00:05.081697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14c168-00c0-481f-ac69-eb005586ce91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:05.083144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14c168-00c0-481f-ac69-eb005586ce91 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:05.088447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 581/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 08:00:04 2022] GET /identity/v3/role_assignments?user.id=48cd66b0407f4d358720ae2bc0c0ae61&scope.project.id=692b9d91e3344e0ca776eb902747ca41&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:07.125620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7ef9-b9a6-4c1a-aff6-c83f9ca313f0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:07.126186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7ef9-b9a6-4c1a-aff6-c83f9ca313f0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:07.126186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7ef9-b9a6-4c1a-aff6-c83f9ca313f0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:07.127514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 605/1186] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:00:07.132571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384cf5b-fd05-4b86-a6ba-20ca49b32626 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:07.132990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384cf5b-fd05-4b86-a6ba-20ca49b32626 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:07.133134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384cf5b-fd05-4b86-a6ba-20ca49b32626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:07.150638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4384cf5b-fd05-4b86-a6ba-20ca49b32626 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:00:07.151994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4384cf5b-fd05-4b86-a6ba-20ca49b32626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:00:07.209040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:07.217496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 582/1187] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:00:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:00:07.239535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e7ef9-b9a6-4c1a-aff6-c83f9ca313f0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:07.338587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e7ef9-b9a6-4c1a-aff6-c83f9ca313f0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:07.340859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:07.372082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:07.372696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:07.372969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:07.373237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:07.382984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:00:07.387505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:00:07.388617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:00:07.389622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 606/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 08:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:00:07.394774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384cf5b-fd05-4b86-a6ba-20ca49b32626 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:07.491304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384cf5b-fd05-4b86-a6ba-20ca49b32626 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:07.524122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:07.524705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:07.524975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:07.525238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:07.525878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:00:07.526169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:07.527549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:07.535148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 583/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 08:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:07.541884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:07.639137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588c6d-206b-43f6-9688-8dc4c3d0de9e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:07.671917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:07.672528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:07.672804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:07.673071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] PATH_INFO: `/v3/users/48cd66b0407f4d358720ae2bc0c0ae61` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:07.674170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] RBAC: Authorizing `identity:get_user(user_id=48cd66b0407f4d358720ae2bc0c0ae61)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:07.675619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:07.677175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 607/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 08:00:07 2022] GET /identity/v3/users/48cd66b0407f4d358720ae2bc0c0ae61 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:07.683713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:07.740282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:07.785548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cde58-a6c8-4182-853e-dc5d720636ea None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:07.820922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022ff55-32e6-4f18-ba17-561bfe0148fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:07.821667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ff55-32e6-4f18-ba17-561bfe0148fb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:07.821997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ff55-32e6-4f18-ba17-561bfe0148fb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:07.822363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ff55-32e6-4f18-ba17-561bfe0148fb None admin] PATH_INFO: `/v3/projects/692b9d91e3344e0ca776eb902747ca41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:07.823499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022ff55-32e6-4f18-ba17-561bfe0148fb None admin] RBAC: Authorizing `identity:get_project(project_id=692b9d91e3344e0ca776eb902747ca41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:07.824920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022ff55-32e6-4f18-ba17-561bfe0148fb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:07.826501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 584/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 08:00:07 2022] GET /identity/v3/projects/692b9d91e3344e0ca776eb902747ca41 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:07.832494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:07.871976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:07.938916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4450c9-a1a6-4f93-9a7b-2c028bed2e96 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:07.971985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394302f-caf3-49a2-b93d-4e6204bcdbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:07.972637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394302f-caf3-49a2-b93d-4e6204bcdbec None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:07.972914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394302f-caf3-49a2-b93d-4e6204bcdbec None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:07.973186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394302f-caf3-49a2-b93d-4e6204bcdbec None admin] PATH_INFO: `/v3/projects/692b9d91e3344e0ca776eb902747ca41/users/48cd66b0407f4d358720ae2bc0c0ae61/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:07.975067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394302f-caf3-49a2-b93d-4e6204bcdbec None admin] RBAC: Authorizing `identity:create_grant(project_id=692b9d91e3344e0ca776eb902747ca41, user_id=48cd66b0407f4d358720ae2bc0c0ae61, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:07.976941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394302f-caf3-49a2-b93d-4e6204bcdbec None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:07.989027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 608/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 08:00:07 2022] PUT /identity/v3/projects/692b9d91e3344e0ca776eb902747ca41/users/48cd66b0407f4d358720ae2bc0c0ae61/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:00:09.960900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1751c8-5ca4-492a-86b8-0af5e3284d5f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:09.961424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1751c8-5ca4-492a-86b8-0af5e3284d5f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:09.961553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1751c8-5ca4-492a-86b8-0af5e3284d5f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:09.962849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 585/1193] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:00:09.968352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf62ec-52af-4a06-ad97-9603bf388bf4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:09.968761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf62ec-52af-4a06-ad97-9603bf388bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:09.968977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf62ec-52af-4a06-ad97-9603bf388bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:09.987526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9ccf62ec-52af-4a06-ad97-9603bf388bf4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:00:09.988697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9ccf62ec-52af-4a06-ad97-9603bf388bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:00:10.052948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 609/1194] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:00:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:00:10.076785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1751c8-5ca4-492a-86b8-0af5e3284d5f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:10.181808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1751c8-5ca4-492a-86b8-0af5e3284d5f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:10.204737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:10.216113 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:10.216755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:10.217076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:10.217388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:10.228017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:00:10.232675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:00:10.233792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:00:10.234844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 586/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 08:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:00:10.239707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf62ec-52af-4a06-ad97-9603bf388bf4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:10.262921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:10.342284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf62ec-52af-4a06-ad97-9603bf388bf4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:10.374669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:10.375257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:10.375557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:10.375827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:10.376472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:00:10.376764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:10.378180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:10.386570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 610/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 08:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:10.392349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:10.489118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51192087-1331-4b07-9740-26b4cc301fe4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:10.521829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:10.522433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:10.522706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:10.522974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] PATH_INFO: `/v3/users/48cd66b0407f4d358720ae2bc0c0ae61` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:10.524092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] RBAC: Authorizing `identity:get_user(user_id=48cd66b0407f4d358720ae2bc0c0ae61)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:10.525513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:10.527042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 587/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 08:00:10 2022] GET /identity/v3/users/48cd66b0407f4d358720ae2bc0c0ae61 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:10.532835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:10.619866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:10.638049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11026ec-4ddd-4cc4-b060-e37012aeeaf0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:10.671368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:10.671989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:10.672265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:10.672533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:10.740318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:10.742876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:10.825838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:10.842071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 611/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 08:00:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:00:10.847971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:10.900227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:10.947428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2f45-1ffc-4a67-9076-31b91fb0e009 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:10.980856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8a308-7c08-4fdf-9c05-ee94daa31a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:10.981471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a308-7c08-4fdf-9c05-ee94daa31a0f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:10.981747 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a308-7c08-4fdf-9c05-ee94daa31a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:10.982019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a308-7c08-4fdf-9c05-ee94daa31a0f None admin] PATH_INFO: `/v3/projects/692b9d91e3344e0ca776eb902747ca41` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:10.983128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8a308-7c08-4fdf-9c05-ee94daa31a0f None admin] RBAC: Authorizing `identity:get_project(project_id=692b9d91e3344e0ca776eb902747ca41)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:10.984592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8a308-7c08-4fdf-9c05-ee94daa31a0f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:10.986194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 588/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 08:00:10 2022] GET /identity/v3/projects/692b9d91e3344e0ca776eb902747ca41 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:10.993020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:00:11.088894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fddb0-3d9c-4e30-b271-f7a5d1003da4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:00:11.122672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942fe62-00ed-471f-9eaa-9074b72f5447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:00:11.123264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942fe62-00ed-471f-9eaa-9074b72f5447 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:00:11.123567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942fe62-00ed-471f-9eaa-9074b72f5447 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:00:11.123840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942fe62-00ed-471f-9eaa-9074b72f5447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:00:11.124548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942fe62-00ed-471f-9eaa-9074b72f5447 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=692b9d91e3344e0ca776eb902747ca41, user.id=48cd66b0407f4d358720ae2bc0c0ae61) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:00:11.124853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942fe62-00ed-471f-9eaa-9074b72f5447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:00:11.126257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942fe62-00ed-471f-9eaa-9074b72f5447 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:00:11.131778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 612/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 08:00:10 2022] GET /identity/v3/role_assignments?user.id=48cd66b0407f4d358720ae2bc0c0ae61&scope.project.id=692b9d91e3344e0ca776eb902747ca41&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:00:20.975184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=40 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:00:21.129247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=76 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:06.282381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09dc2b-25a6-45a4-9294-e1347b2cd3b8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:06.283099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09dc2b-25a6-45a4-9294-e1347b2cd3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:06.283099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09dc2b-25a6-45a4-9294-e1347b2cd3b8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:06.284511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 589/1201] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:06.295583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dea3b7-72b7-430c-9672-6104047c8834 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:06.295583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dea3b7-72b7-430c-9672-6104047c8834 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:06.295583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dea3b7-72b7-430c-9672-6104047c8834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:06.318857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-01dea3b7-72b7-430c-9672-6104047c8834 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:06.320539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-01dea3b7-72b7-430c-9672-6104047c8834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:06.407448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 613/1202] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:06.437515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09dc2b-25a6-45a4-9294-e1347b2cd3b8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:06.580656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09dc2b-25a6-45a4-9294-e1347b2cd3b8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:06.620913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:06.621625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:06.621974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:06.622211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:06.635502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:06.639385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:06.657871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:06.659238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:06.661147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:06.661147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:06.661147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:06.663615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 590/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:06.666742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dea3b7-72b7-430c-9672-6104047c8834 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:06.804426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dea3b7-72b7-430c-9672-6104047c8834 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:06.845467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:06.852999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4b0f0-a60b-433d-8981-5a962773914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:06.853745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4b0f0-a60b-433d-8981-5a962773914b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:06.854083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4b0f0-a60b-433d-8981-5a962773914b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:06.854486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4b0f0-a60b-433d-8981-5a962773914b None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:06.855337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4b0f0-a60b-433d-8981-5a962773914b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:06.855876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4b0f0-a60b-433d-8981-5a962773914b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:06.857598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4b0f0-a60b-433d-8981-5a962773914b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:06.878598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 614/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:06.881681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:06.949923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:07.012707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c7d2d-9a58-44cb-ae04-623496637ff2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:07.067552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3524ba-7f1d-4692-b0ca-9901f0db1f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:07.071118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3524ba-7f1d-4692-b0ca-9901f0db1f95 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:07.071118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3524ba-7f1d-4692-b0ca-9901f0db1f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:07.071118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3524ba-7f1d-4692-b0ca-9901f0db1f95 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:07.071118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3524ba-7f1d-4692-b0ca-9901f0db1f95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:07.071118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3524ba-7f1d-4692-b0ca-9901f0db1f95 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:07.099742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 591/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 08:01:06 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:01:09.543367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfee05-9542-48a4-a32d-ff5745ae13ed None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:09.543964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfee05-9542-48a4-a32d-ff5745ae13ed None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:09.543964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfee05-9542-48a4-a32d-ff5745ae13ed None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:09.545467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 615/1206] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:01:09.551490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a650e4-d2f1-49d9-89f2-577579dc411f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:09.552377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a650e4-d2f1-49d9-89f2-577579dc411f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:09.552377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a650e4-d2f1-49d9-89f2-577579dc411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:09.573855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d5a650e4-d2f1-49d9-89f2-577579dc411f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:09.574989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d5a650e4-d2f1-49d9-89f2-577579dc411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:09.661211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 592/1207] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:09.685026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfee05-9542-48a4-a32d-ff5745ae13ed None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:09.811744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfee05-9542-48a4-a32d-ff5745ae13ed None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:09.852440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:09.852964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:09.853269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:09.853514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:09.868329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:01:09.874357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:09.881422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:09.882553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 616/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 08:01:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:01:09.884939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a650e4-d2f1-49d9-89f2-577579dc411f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:09.928683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:10.005938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a650e4-d2f1-49d9-89f2-577579dc411f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:10.046143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:10.047053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:10.047342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:10.047872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:10.048278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:10.048582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:10.049952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:10.059921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 593/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 08:01:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:10.065951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:10.130708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:10.187681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf00d8-06b0-455f-a3a9-f22822bd8b05 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:10.227400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:10.228241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:10.228586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:10.228952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:10.241104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:10.242803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:10.259399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:10.260495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:10.261422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:10.261422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:10.261422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:10.261422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 617/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:10.266472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:10.384518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:10.387612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601498a-8f2e-4042-bd2f-bc0d6718a991 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:10.427879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:10.428561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:10.428902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:10.429161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:10.430038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:10.430363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:10.431953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:10.446826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 594/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:01:10.451440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:10.568993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd9548-93bd-4e40-ab91-84d844d7cc14 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:10.570988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:10.607883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:10.608515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:10.608789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:10.609057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:10.620675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:10.621661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:01:10.635720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:10.636796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:10.637804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 618/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:10.642867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:10.769097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dadf85-e0a8-49cf-a007-97a6dd6ee4fa None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:10.810726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:10.811897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:10.811897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:10.811897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:10.812634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:10.812877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:10.814279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:10.833862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 595/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 08:01:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:10.839883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:10.974252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22873b-cf60-4718-9f0e-6932829a0c24 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:11.017199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:11.017853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:11.018925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:11.018925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:11.057085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:11.102377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:11.103910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:11.215479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 619/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 08:01:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:01:11.220964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:11.243112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:11.333074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167847-7faa-4dd1-ada0-b28c853da7e9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:11.369205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:11.369864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:11.370142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:11.370412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:11.382179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:11.383696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:11.399221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:11.400312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:11.401243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:11.401243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:11.401243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:11.405123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 596/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:11.406099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:11.481600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:11.529305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7beab2-5e00-443e-9951-9170b145fede None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:11.567783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:11.568403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:11.568681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:11.568955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:11.569593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:11.570126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:11.571244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:11.584427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 620/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:11.590958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:11.674183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:11.710626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d409d-c1fa-4034-85cf-d3d76c12a379 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:11.751067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:11.751740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:11.752018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:11.752292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:11.759717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:11.761308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:01:11.773752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:11.775229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:11.776217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 597/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 08:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:11.782772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:11.908626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6c3ff-59e6-4e81-8a7d-3a1e5789ae6e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:11.936930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:11.960367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3f97f-8b83-4aec-a79a-ba2f9e0c1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:11.960979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3f97f-8b83-4aec-a79a-ba2f9e0c1e81 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:11.961255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3f97f-8b83-4aec-a79a-ba2f9e0c1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:11.961525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3f97f-8b83-4aec-a79a-ba2f9e0c1e81 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:11.962212 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3f97f-8b83-4aec-a79a-ba2f9e0c1e81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:11.962514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3f97f-8b83-4aec-a79a-ba2f9e0c1e81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:11.963961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3f97f-8b83-4aec-a79a-ba2f9e0c1e81 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:11.977517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 621/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 08:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:11.984684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:12.102727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23537f46-f25c-496c-9059-7cb20bc9d820 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:12.138721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:12.146385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd4475-5997-409f-acf2-017246a38637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:12.146992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4475-5997-409f-acf2-017246a38637 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:12.147269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4475-5997-409f-acf2-017246a38637 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:12.147569 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4475-5997-409f-acf2-017246a38637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:12.148436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd4475-5997-409f-acf2-017246a38637 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=8ab28faeca0b4289b501d17ceb360378) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:12.148763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd4475-5997-409f-acf2-017246a38637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:12.150578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd4475-5997-409f-acf2-017246a38637 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:12.156697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 598/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 08:01:11 2022] GET /identity/v3/role_assignments?user.id=8ab28faeca0b4289b501d17ceb360378&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:14.196622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732740f-f7ad-4507-b001-bfdfb20bfbaa None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:14.197219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732740f-f7ad-4507-b001-bfdfb20bfbaa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:14.197219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732740f-f7ad-4507-b001-bfdfb20bfbaa None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:14.198577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 622/1220] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:14.204018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d6997-5486-49d4-86e8-9c74f0671429 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:14.204479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d6997-5486-49d4-86e8-9c74f0671429 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:14.204619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d6997-5486-49d4-86e8-9c74f0671429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:14.223161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2a4d6997-5486-49d4-86e8-9c74f0671429 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:14.224614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2a4d6997-5486-49d4-86e8-9c74f0671429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:14.296197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 599/1221] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:14.319968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732740f-f7ad-4507-b001-bfdfb20bfbaa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:14.429133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732740f-f7ad-4507-b001-bfdfb20bfbaa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:14.464769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:14.465312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:14.465591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:14.465861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:14.476306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:01:14.481372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:14.482358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:14.483232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 623/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 08:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:14.490228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d6997-5486-49d4-86e8-9c74f0671429 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:14.596024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d6997-5486-49d4-86e8-9c74f0671429 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:14.624927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:14.636521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:14.637135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:14.637400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:14.637716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:14.638375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:14.638679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:14.640083 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:14.648092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 600/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 08:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:14.653887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:14.700612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:14.762866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe36a02-aa7c-4259-9de9-787814f37c5a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:14.796681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:14.797306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:14.797580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:14.797846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:14.809443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:14.810897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:14.825809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:14.826972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:14.828074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:14.828074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:14.828074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:14.828074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 624/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:14.833295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:14.944407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad82ce-6663-4e48-af8b-1103a7e0639e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:14.980738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:14.981528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:14.981900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:14.982458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:14.983248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:14.983709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:14.985437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:15.001031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 601/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:15.007702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:15.111400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:15.119838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa60e7-44b5-4ff9-b359-58d7e23be1f2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:15.157131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:15.157801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:15.158092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:15.158413 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:15.167295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:15.168960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:01:15.181447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:15.182743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:15.183748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 625/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:15.188421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:15.238447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:15.293172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ec79-26f8-4e42-8883-3784197d201e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:15.330589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:15.331195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:15.331518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:15.331822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:15.333076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:15.333493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:15.334940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:15.352840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 602/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 08:01:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:15.358555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:15.479361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e665fca-0054-47eb-a401-f6606ba6eb8d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:15.517320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:15.517939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:15.518289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:15.518555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:15.530540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:15.532295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:15.551893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:15.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:15.554237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:15.554237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:15.554237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:15.554237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 626/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:15.559207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:15.673735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5e686-ea03-40ca-9271-6b8436fd8798 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:15.676423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:15.711408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:15.712042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:15.712320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:15.712591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:15.713233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:15.713553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:15.715270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:15.729663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 603/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:01:15.736386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:15.749102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:15.847623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcc3d7-11a3-4802-9a5d-8aad09d92519 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:15.883836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:15.884462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:15.884739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:15.885010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:15.891898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:15.893339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:01:15.905545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:15.906627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:15.907603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 627/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 08:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:15.913340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:16.031136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9028754-e774-4ad3-88d9-354d39ce53c5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:16.069427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b7c0d-24ec-4aa0-af2d-953399f8e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:16.070075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7c0d-24ec-4aa0-af2d-953399f8e434 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:16.070326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7c0d-24ec-4aa0-af2d-953399f8e434 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:16.070592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7c0d-24ec-4aa0-af2d-953399f8e434 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:16.071265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b7c0d-24ec-4aa0-af2d-953399f8e434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:16.071591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b7c0d-24ec-4aa0-af2d-953399f8e434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:16.073079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b7c0d-24ec-4aa0-af2d-953399f8e434 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:16.087875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 604/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 08:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:01:16.093938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:16.167322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:16.208966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d60fa-ebfb-4636-9cb6-5f809b926607 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:16.245292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5937ec1-96af-4992-ab8a-92cee61dd598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:16.246020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937ec1-96af-4992-ab8a-92cee61dd598 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:16.246330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937ec1-96af-4992-ab8a-92cee61dd598 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:16.246655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937ec1-96af-4992-ab8a-92cee61dd598 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/8ab28faeca0b4289b501d17ceb360378/roles/13b0eb7c0ad04dba9ae829944539f1f6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:16.262481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5937ec1-96af-4992-ab8a-92cee61dd598 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=8ab28faeca0b4289b501d17ceb360378, role_id=13b0eb7c0ad04dba9ae829944539f1f6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:16.264072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5937ec1-96af-4992-ab8a-92cee61dd598 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:16.276661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 628/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 08:01:16 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/8ab28faeca0b4289b501d17ceb360378/roles/13b0eb7c0ad04dba9ae829944539f1f6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:01:18.374208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ac113-84c0-4102-9943-0b901df5e0ce None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:18.374766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ac113-84c0-4102-9943-0b901df5e0ce None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:18.374766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ac113-84c0-4102-9943-0b901df5e0ce None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:18.376082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 605/1233] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:18.381798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63739d49-b0a9-4f24-b874-b889b406b37f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:18.382206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63739d49-b0a9-4f24-b874-b889b406b37f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:18.382337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63739d49-b0a9-4f24-b874-b889b406b37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:18.401721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-63739d49-b0a9-4f24-b874-b889b406b37f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:18.402938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-63739d49-b0a9-4f24-b874-b889b406b37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:18.475585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 629/1234] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:18.499741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ac113-84c0-4102-9943-0b901df5e0ce None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:18.527999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:18.613087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ac113-84c0-4102-9943-0b901df5e0ce None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:18.651074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:18.651729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:18.652007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:18.652272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:18.663439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:01:18.668060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:18.669293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:18.670408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 606/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 08:01:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:18.678524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63739d49-b0a9-4f24-b874-b889b406b37f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:18.726371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:18.782545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63739d49-b0a9-4f24-b874-b889b406b37f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:18.820188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:18.820944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:18.821314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:18.821677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:18.822435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:18.822864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:18.824447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:18.833020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 630/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 08:01:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:18.838778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:18.931827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:18.954510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5dba6-c61b-43f1-880f-2f21f5b544b6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:18.991431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:18.992068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:18.992344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:18.992616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:19.005036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:19.006906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:19.029128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:19.030490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:19.031809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:19.031809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:19.031809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:19.031809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 607/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:19.036638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:19.159656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ce968-2938-4cd9-8ed7-eddfeb4a0dc3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:19.169377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:19.196865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:19.197380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:19.197651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:19.198044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:19.198825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:19.199123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:19.200725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:19.213836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 631/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:19.219972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:19.332225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73720b-0fa4-49b2-8abe-bfad9efcaac7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:19.367631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:19.368252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:19.368541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:19.368801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:19.371935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:19.377413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:19.379074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:01:19.390634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:19.391762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:19.392751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 608/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:19.398339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:19.522604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912af2b-be37-4b66-9b24-7556b3095c05 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:19.556629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:19.557223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:19.557528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:19.557763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:19.558477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:19.558775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:19.560225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:19.580115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 632/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 08:01:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:19.586528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:19.700936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2847a8-a503-416f-b64f-ac3cb02f0cf4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:19.735243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:19.735868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:19.736140 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:19.736407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:19.799840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:19.811932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:19.813568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:19.932206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 609/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 08:01:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:01:19.938516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:19.973356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:20.066711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fdaf6-7e09-4f6d-a9db-e8c593c52c74 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:20.104938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:20.105543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:20.105820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:20.106130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:20.117946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:20.119698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:20.135313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:20.136575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:20.137647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:20.137647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:20.137647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:20.137647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 633/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:20.142206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:20.244624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:20.250075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810ff0-c1c1-4192-ba4b-ea7a5804b259 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:20.288230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:20.288683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:20.289009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:20.289400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:20.290323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:20.290605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:20.292228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:20.306333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 610/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:20.312014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:20.405498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:20.431205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da8120-7ab4-4a94-8420-71fdeaa9d410 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:20.473708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:20.474479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:20.474753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:20.475168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:20.482883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:20.484507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:01:20.498341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:20.499628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:20.500724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 634/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 08:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:01:20.507036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:20.627341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824bc9-3616-4381-9cdb-e60673a0cad4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:20.670673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46e23-2459-4e37-96c4-215e1973dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:20.671404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46e23-2459-4e37-96c4-215e1973dff7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:20.671808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46e23-2459-4e37-96c4-215e1973dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:20.672090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46e23-2459-4e37-96c4-215e1973dff7 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:20.672798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46e23-2459-4e37-96c4-215e1973dff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:20.673091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46e23-2459-4e37-96c4-215e1973dff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:20.674536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46e23-2459-4e37-96c4-215e1973dff7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:20.688246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 611/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 08:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:01:20.695544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:20.810150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34be2-b4a3-4ea7-afd7-bd50c682db92 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:20.856072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5ccd8-389e-4604-8654-a5759a6a0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:20.856804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ccd8-389e-4604-8654-a5759a6a0933 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:20.857085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ccd8-389e-4604-8654-a5759a6a0933 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:20.857362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ccd8-389e-4604-8654-a5759a6a0933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:20.858236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ccd8-389e-4604-8654-a5759a6a0933 None admin] RBAC: Adding query filter params (role.id=13b0eb7c0ad04dba9ae829944539f1f6, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=8ab28faeca0b4289b501d17ceb360378) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:20.858632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ccd8-389e-4604-8654-a5759a6a0933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:20.860278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ccd8-389e-4604-8654-a5759a6a0933 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:20.869790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 635/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 08:01:20 2022] GET /identity/v3/role_assignments?user.id=8ab28faeca0b4289b501d17ceb360378&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=13b0eb7c0ad04dba9ae829944539f1f6 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:23.068517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2efc-52dc-46bf-ae63-8dd9a6abdf2d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:23.069244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2efc-52dc-46bf-ae63-8dd9a6abdf2d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:23.069244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2efc-52dc-46bf-ae63-8dd9a6abdf2d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:23.070456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 612/1247] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:23.076384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38af2-3b93-436d-814e-e344f3085efd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:23.076836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38af2-3b93-436d-814e-e344f3085efd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:23.076932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38af2-3b93-436d-814e-e344f3085efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:23.084132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:23.098426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6af38af2-3b93-436d-814e-e344f3085efd None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:23.099847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6af38af2-3b93-436d-814e-e344f3085efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:23.173200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 636/1248] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:01:23.197387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c2efc-52dc-46bf-ae63-8dd9a6abdf2d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:23.216902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:23.326004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c2efc-52dc-46bf-ae63-8dd9a6abdf2d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:23.371494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:23.372227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:23.372768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:23.373156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:23.388553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:01:23.395534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:23.396547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:23.397763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 613/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 08:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:23.404983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af38af2-3b93-436d-814e-e344f3085efd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:23.516933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af38af2-3b93-436d-814e-e344f3085efd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:23.553658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:23.559331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:23.559975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:23.560251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:23.560626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:23.561196 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:23.561482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:23.562858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:23.572221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 637/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 08:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:23.578566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:23.665488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:23.692848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eae1e0-f128-4558-99b3-b630c5402488 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:23.730044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:23.730752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:23.731062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:23.731352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:23.747561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:23.749291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:23.764990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:23.766139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:23.767699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:23.767699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:23.767699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:23.767699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 614/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:23.773166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:23.890394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ef51-0bfa-4570-bcdb-9968ef1529fa None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:23.930913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:23.931546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:23.931825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:23.932114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:23.932954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:23.933144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:23.934491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:23.948652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 638/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:01:23.954571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:24.072961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d9fc-ffaa-45b8-8b4b-2d1adeed33d0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:24.101197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:24.109358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:24.109981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:24.110257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:24.110548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:24.118904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:24.120389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:01:24.132551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:24.134093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:24.135328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 615/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:24.139626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:24.201809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:24.250021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee246a-fd27-4601-b818-d1c75bcca35f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:24.287349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:24.288015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:24.288290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:24.288589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:24.289750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:24.290128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:24.291551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:24.311274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 639/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 08:01:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:01:24.317226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:24.438412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3788-eeb4-41e4-bbc8-d50f6022af78 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:24.476855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:24.477508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:24.477791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:24.478064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:24.538111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:24.551901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:24.553517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:24.665780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 616/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 08:01:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:01:24.672477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:24.785775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec773-e3a8-40ee-a974-d5d6dc044f05 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:24.798522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:24.821080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:24.821867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:24.822146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:24.822416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:24.833756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:24.835640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:24.853289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:24.854437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:24.860138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:24.860138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:24.860138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:24.860138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 640/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:24.860433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:24.964583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:24.980913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad36408-f5c8-4ade-b382-1e8a2b88da89 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:25.031481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:25.032209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:25.032578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:25.033054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:25.034311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:25.034805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:25.036565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:25.050502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 617/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:25.057232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:25.167695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf677b4-ec77-4982-a784-397ebce0bbd6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:25.208318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:25.208967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:25.209237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:25.209501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:25.216240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:25.217662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:01:25.229273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:25.230219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:25.231187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 641/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 08:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:25.236455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:25.342592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a578-6f6c-4de1-83d3-11efe20b1659 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:25.377819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682048b-312b-4bfb-83da-35e6851c0123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:25.378481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682048b-312b-4bfb-83da-35e6851c0123 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:25.379247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682048b-312b-4bfb-83da-35e6851c0123 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:25.379543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682048b-312b-4bfb-83da-35e6851c0123 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:25.380231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682048b-312b-4bfb-83da-35e6851c0123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:25.380515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682048b-312b-4bfb-83da-35e6851c0123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:25.381941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682048b-312b-4bfb-83da-35e6851c0123 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:25.395325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 618/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 08:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:25.402320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:25.429423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:25.523096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141c5cf-42e1-4127-9d24-34bcaad27a1b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:25.563188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074acfea-b015-4958-99bf-8119486a1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:25.563777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074acfea-b015-4958-99bf-8119486a1deb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:25.564029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074acfea-b015-4958-99bf-8119486a1deb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:25.564261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074acfea-b015-4958-99bf-8119486a1deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:25.565062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074acfea-b015-4958-99bf-8119486a1deb None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=8ab28faeca0b4289b501d17ceb360378) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:25.565359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074acfea-b015-4958-99bf-8119486a1deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:25.567788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074acfea-b015-4958-99bf-8119486a1deb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:25.573640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 642/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 08:01:25 2022] GET /identity/v3/role_assignments?user.id=8ab28faeca0b4289b501d17ceb360378&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:27.666374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f40976-0c1a-411c-a7db-1e23c7766331 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:27.666879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f40976-0c1a-411c-a7db-1e23c7766331 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:27.666879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f40976-0c1a-411c-a7db-1e23c7766331 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:27.668201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 619/1261] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:27.673332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00102-390a-4282-b75a-69143c61eb9d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:27.673718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00102-390a-4282-b75a-69143c61eb9d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:27.673875 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00102-390a-4282-b75a-69143c61eb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:27.692951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3cf00102-390a-4282-b75a-69143c61eb9d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:27.694129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3cf00102-390a-4282-b75a-69143c61eb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:27.757495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 643/1262] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:27.779381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f40976-0c1a-411c-a7db-1e23c7766331 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:27.790116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:27.879745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f40976-0c1a-411c-a7db-1e23c7766331 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:27.911683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:27.912291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:27.912562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:27.912825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:27.922468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:01:27.927554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:27.928647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:27.929964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 620/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 08:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:27.934741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00102-390a-4282-b75a-69143c61eb9d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:27.953007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:28.035739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00102-390a-4282-b75a-69143c61eb9d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:28.069516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:28.070115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:28.070394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:28.070666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:28.071325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:28.071655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:28.073016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:28.080758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 644/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 08:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:28.086955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:28.152131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:28.184920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2f7e-9aff-484b-ab85-d00f3d418998 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:28.217015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:28.217621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:28.217896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:28.218167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:28.228273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:28.229701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:28.245645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:28.246776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:28.247915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:28.247915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:28.247915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:28.247915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 621/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:28.252464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:28.333076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:28.353153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380f673-5c6b-41f0-9140-f5ccd48d8c3f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:28.385780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:28.386377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:28.386654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:28.386924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:28.387585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:28.387889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:28.389235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:28.400967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 645/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:28.406610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:28.502330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b53a-db5c-4bd7-8d91-e41e9995d55e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:28.521311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:28.535544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:28.536196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:28.536471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:28.536734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:28.543833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:28.545259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:01:28.556172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:28.557311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:28.558468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 622/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:28.562929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:28.658522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790ca11-5ce0-453b-8faf-a32da338f4f5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:28.692377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:28.692963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:28.693242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:28.693512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:28.694226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:28.694527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:28.695979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:28.704398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:28.713865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 646/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 08:01:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:28.719444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:28.816304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385a958-ca95-49a9-8054-7802965a77c5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:28.848399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:28.849000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:28.849276 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:28.849546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:28.859611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:28.861044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:28.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:28.879562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:28.880674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:28.880674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:28.880674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:28.880674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 623/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:28.881653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:28.981711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4302-9bda-4fd7-b317-350706549714 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:29.019702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:29.020302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:29.020578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:29.020847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:29.021477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:29.021773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:29.023138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:29.034001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 647/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:29.040415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:29.072388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:29.139648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81385d9-f55e-4113-86aa-914cb24741d7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:29.171543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:29.172152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:29.172425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:29.172691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:29.180130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:29.181560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:01:29.192855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:29.193928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:29.195057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 624/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 08:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:29.199672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:29.256531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:29.297362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360d0e-6cd5-4ead-ac39-4e7015c638dd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:29.331000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4631c5-0087-4aa1-b849-6abc451f3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:29.331724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4631c5-0087-4aa1-b849-6abc451f3663 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:29.332040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4631c5-0087-4aa1-b849-6abc451f3663 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:29.332307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4631c5-0087-4aa1-b849-6abc451f3663 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:29.332986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4631c5-0087-4aa1-b849-6abc451f3663 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:29.333310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4631c5-0087-4aa1-b849-6abc451f3663 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:29.334707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4631c5-0087-4aa1-b849-6abc451f3663 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:29.346355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 648/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 08:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:29.352840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:29.441774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:29.450854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e9303-1959-4baf-ae6a-f05b0e486c32 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:29.482530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2de8f6-3b00-4fc7-9480-dcc119aab022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:29.483165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2de8f6-3b00-4fc7-9480-dcc119aab022 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:29.483460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2de8f6-3b00-4fc7-9480-dcc119aab022 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:29.483733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2de8f6-3b00-4fc7-9480-dcc119aab022 None admin] PATH_INFO: `/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/8ab28faeca0b4289b501d17ceb360378/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:29.485574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2de8f6-3b00-4fc7-9480-dcc119aab022 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user_id=8ab28faeca0b4289b501d17ceb360378, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:29.487002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2de8f6-3b00-4fc7-9480-dcc119aab022 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:29.499691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 625/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 08:01:29 2022] PUT /identity/v3/projects/7d7cf69e7a7e46a78e50bc1ec7d912cf/users/8ab28faeca0b4289b501d17ceb360378/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:01:31.489573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427c92-2b32-4558-bd8e-c64ebc0b9dfa None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:31.490130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427c92-2b32-4558-bd8e-c64ebc0b9dfa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:31.490130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427c92-2b32-4558-bd8e-c64ebc0b9dfa None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:31.491446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 649/1274] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:01:31.496419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8623a-2550-424b-867d-99b472684053 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:31.496871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8623a-2550-424b-867d-99b472684053 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:31.496983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8623a-2550-424b-867d-99b472684053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:31.515235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-61f8623a-2550-424b-867d-99b472684053 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:31.516430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-61f8623a-2550-424b-867d-99b472684053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:31.580518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 626/1275] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:31.604600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427c92-2b32-4558-bd8e-c64ebc0b9dfa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:31.702733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427c92-2b32-4558-bd8e-c64ebc0b9dfa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:31.719839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:31.736949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:31.737589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:31.737873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:31.738147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:31.748070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:01:31.752730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:31.754622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:31.755746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 650/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 08:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:31.760264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8623a-2550-424b-867d-99b472684053 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:31.837802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:31.856558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8623a-2550-424b-867d-99b472684053 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:31.890380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:31.890970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:31.891242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:31.891541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:31.892188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:31.892482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:31.894490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:31.902086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 627/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 08:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:31.907684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:32.009808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cb77-41dc-4d74-843e-ce7c12f7347c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:32.049794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:32.050746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:32.051085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:32.051372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:32.061891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:32.063336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:32.078927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:32.080094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:32.081194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:32.081194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:32.081194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:32.081194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 651/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:32.088729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:32.186700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167ec10-560c-4724-ab07-1b20806fb020 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:32.219583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:32.220166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:32.220437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:32.220702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:32.221321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:32.221613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:32.223202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:32.234262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 628/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:32.240471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:32.271298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:32.340046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6db31f-3ff8-4f75-a0a4-091e8ba5f721 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:32.372121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:32.372732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:32.373005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:32.373273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:32.381025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:32.382447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:01:32.393017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:32.394265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:32.395456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 652/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:32.399999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:32.403764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:32.497776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670cf92-9bfe-4534-9f44-b2e0393883fc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:32.530456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:32.531047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:32.531323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:32.531619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:32.532334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:32.532634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:32.534050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:32.551367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 629/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 08:01:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:32.557303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:32.644171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:32.653787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a7733-820b-407d-8f6c-063087ca59bf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:32.686525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:32.687114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:32.687391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:32.687693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:32.752091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:32.753590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:32.837014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:32.847906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 653/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 08:01:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:01:32.853664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:32.914413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:32.954416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb9d14-5a47-4356-bd94-6502eff9f95c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:32.990889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:32.991526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:32.991805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:32.992076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.001736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:33.003227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:01:33.018079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:33.019908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:01:33.020838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:01:33.020838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:01:33.020838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:33.020838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 630/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:33.025526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:33.120669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca8f80-47d6-4dbf-bde2-b541cf36608b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:33.152679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:33.153261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:33.153532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:33.153796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.154416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:33.154712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:33.156067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:33.167436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 654/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 08:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:33.173023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:33.272586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128f4d-c2f7-496b-a25c-f4df4c1dda7a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:33.285760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:33.306832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:33.307486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:33.307767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:33.308039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.314571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:33.316544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:01:33.327675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:33.328737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Aug 10 08:01:33.329686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 631/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 08:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:33.335181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:33.384374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:33.433151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c878-6541-485e-a2ae-54742d77eacd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:33.465536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919776d2-c20c-4277-a8d5-6b3b5e1fa598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:33.466124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919776d2-c20c-4277-a8d5-6b3b5e1fa598 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:33.466402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919776d2-c20c-4277-a8d5-6b3b5e1fa598 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:33.466672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919776d2-c20c-4277-a8d5-6b3b5e1fa598 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.467356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919776d2-c20c-4277-a8d5-6b3b5e1fa598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:33.467686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919776d2-c20c-4277-a8d5-6b3b5e1fa598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:33.469110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919776d2-c20c-4277-a8d5-6b3b5e1fa598 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:33.480805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 655/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 08:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:33.486994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:33.584647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee403be-cfd7-4b73-bc76-00da7421ba66 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:33.617116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4369fbc-79c8-45de-8dee-a4d134e37e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:33.617693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4369fbc-79c8-45de-8dee-a4d134e37e55 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:33.617964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4369fbc-79c8-45de-8dee-a4d134e37e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:33.618228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4369fbc-79c8-45de-8dee-a4d134e37e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:33.618926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4369fbc-79c8-45de-8dee-a4d134e37e55 None admin] RBAC: Adding query filter params (role.id=7f4fb728b8644985aa52cf747734ee50, scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf, user.id=8ab28faeca0b4289b501d17ceb360378) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:33.619223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4369fbc-79c8-45de-8dee-a4d134e37e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:33.620665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4369fbc-79c8-45de-8dee-a4d134e37e55 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:33.626118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 632/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 08:01:33 2022] GET /identity/v3/role_assignments?user.id=8ab28faeca0b4289b501d17ceb360378&scope.project.id=7d7cf69e7a7e46a78e50bc1ec7d912cf&role.id=7f4fb728b8644985aa52cf747734ee50 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:35.671897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562402c-3ff2-4d40-9b7f-a82feb2c68ff None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:35.672453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562402c-3ff2-4d40-9b7f-a82feb2c68ff None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:35.672453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562402c-3ff2-4d40-9b7f-a82feb2c68ff None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:35.673672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 656/1288] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:35.679783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9359d-bef5-492d-bf41-e4d8830a5e54 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:35.680214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9359d-bef5-492d-bf41-e4d8830a5e54 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:35.680337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9359d-bef5-492d-bf41-e4d8830a5e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:35.698114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-44f9359d-bef5-492d-bf41-e4d8830a5e54 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:35.699290 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-44f9359d-bef5-492d-bf41-e4d8830a5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:35.727999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:35.764089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 633/1289] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:35.786481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562402c-3ff2-4d40-9b7f-a82feb2c68ff None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:35.885476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562402c-3ff2-4d40-9b7f-a82feb2c68ff None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:35.896506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:35.920515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:35.921137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:35.921409 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:35.921675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:35.922297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:35.923620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:35.932691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:35.934072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:35.935254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 657/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 08:01:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:35.939805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9359d-bef5-492d-bf41-e4d8830a5e54 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:36.049947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9359d-bef5-492d-bf41-e4d8830a5e54 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:36.085602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f793cd5-de67-4e41-ad5c-d197ff553507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:36.086198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793cd5-de67-4e41-ad5c-d197ff553507 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:36.086472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793cd5-de67-4e41-ad5c-d197ff553507 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:36.086739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793cd5-de67-4e41-ad5c-d197ff553507 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:36.087352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793cd5-de67-4e41-ad5c-d197ff553507 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:36.087676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793cd5-de67-4e41-ad5c-d197ff553507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:36.089038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793cd5-de67-4e41-ad5c-d197ff553507 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:36.093667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 634/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 08:01:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:36.100260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:36.195392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a06d-13da-4872-b127-c5535a141415 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:36.228147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802c2be-ba28-4360-bf95-0eeadb4f1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:36.228735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802c2be-ba28-4360-bf95-0eeadb4f1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:36.229012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802c2be-ba28-4360-bf95-0eeadb4f1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:36.229283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802c2be-ba28-4360-bf95-0eeadb4f1ce0 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:36.229898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802c2be-ba28-4360-bf95-0eeadb4f1ce0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:36.230193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802c2be-ba28-4360-bf95-0eeadb4f1ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:36.231570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802c2be-ba28-4360-bf95-0eeadb4f1ce0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:36.235795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 658/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 08:01:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:38.189807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf42e1-b7e8-480c-9e95-5c7cf9801f67 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:38.190376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf42e1-b7e8-480c-9e95-5c7cf9801f67 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:38.190376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf42e1-b7e8-480c-9e95-5c7cf9801f67 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:38.191810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 635/1293] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:38.196897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa404a-ee0a-430f-85f1-e815d1faa493 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:38.197341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa404a-ee0a-430f-85f1-e815d1faa493 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:38.197438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa404a-ee0a-430f-85f1-e815d1faa493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:38.215297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e9fa404a-ee0a-430f-85f1-e815d1faa493 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:38.216487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e9fa404a-ee0a-430f-85f1-e815d1faa493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:38.244631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:38.280121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 659/1294] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:38.302653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf42e1-b7e8-480c-9e95-5c7cf9801f67 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:38.333740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:38.403579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf42e1-b7e8-480c-9e95-5c7cf9801f67 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:38.436631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12101d80-04b3-4865-9f42-2bfe1503f1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:38.437221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12101d80-04b3-4865-9f42-2bfe1503f1af None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:38.437495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12101d80-04b3-4865-9f42-2bfe1503f1af None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:38.437762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12101d80-04b3-4865-9f42-2bfe1503f1af None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:38.438404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12101d80-04b3-4865-9f42-2bfe1503f1af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:38.439908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12101d80-04b3-4865-9f42-2bfe1503f1af None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:38.453497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 636/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 08:01:38 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:01:40.444866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61249a-dd8e-4117-93a8-cd10e28fd6fd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:40.445390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61249a-dd8e-4117-93a8-cd10e28fd6fd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:40.445390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61249a-dd8e-4117-93a8-cd10e28fd6fd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:40.446738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 660/1296] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:40.451724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c643d0-f199-4c40-8b7f-6ac046f29162 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:40.452165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c643d0-f199-4c40-8b7f-6ac046f29162 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:40.452270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c643d0-f199-4c40-8b7f-6ac046f29162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:40.470789 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-63c643d0-f199-4c40-8b7f-6ac046f29162 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:40.472020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-63c643d0-f199-4c40-8b7f-6ac046f29162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:40.542526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 637/1297] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:40.565057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61249a-dd8e-4117-93a8-cd10e28fd6fd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:40.662656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61249a-dd8e-4117-93a8-cd10e28fd6fd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:40.696352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:40.696969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:40.697249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:40.697521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:40.698096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:40.699468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:40.708142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:40.709322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:40.710227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 661/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 08:01:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:40.715659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c643d0-f199-4c40-8b7f-6ac046f29162 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:40.733845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:40.815503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c643d0-f199-4c40-8b7f-6ac046f29162 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:40.847697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:40.848288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:40.848560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:40.848825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:40.849435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:40.849725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:40.851079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:40.855991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 638/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 08:01:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:40.861978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:40.892993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:40.959901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3ddba-fd11-4d6f-830a-d81ebf20b2a9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:41.002823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bf9cb-aa1d-4572-a388-707e385419b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:41.003457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf9cb-aa1d-4572-a388-707e385419b3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:41.003729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf9cb-aa1d-4572-a388-707e385419b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:41.004024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf9cb-aa1d-4572-a388-707e385419b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:41.004705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bf9cb-aa1d-4572-a388-707e385419b3 None admin] RBAC: Adding query filter params (interface=public, service_id=38651c318dc848dd823b811ac3ab9047, region_id=RegionOne) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:41.005009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bf9cb-aa1d-4572-a388-707e385419b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:41.006636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bf9cb-aa1d-4572-a388-707e385419b3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:41.014076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 662/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 08:01:40 2022] GET /identity/v3/endpoints?service_id=38651c318dc848dd823b811ac3ab9047&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:41.020423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:41.100719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:41.119240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973bea4-599f-4871-81eb-44ea6fde1a73 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:41.152588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea820e6d-363e-4e81-8c3f-ca66383a4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:41.153175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820e6d-363e-4e81-8c3f-ca66383a4c49 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:41.153450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820e6d-363e-4e81-8c3f-ca66383a4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:41.153718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820e6d-363e-4e81-8c3f-ca66383a4c49 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:41.154312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea820e6d-363e-4e81-8c3f-ca66383a4c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:41.155701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea820e6d-363e-4e81-8c3f-ca66383a4c49 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:41.162881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 639/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 08:01:41 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:01:43.144523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800ed1-5932-4b2b-8e08-6afbf5790b95 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:43.145118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800ed1-5932-4b2b-8e08-6afbf5790b95 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:43.145118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800ed1-5932-4b2b-8e08-6afbf5790b95 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:43.146391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 663/1302] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:01:43.151395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58717e-8914-4f57-93ab-59dc1b9cefe2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:43.151843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58717e-8914-4f57-93ab-59dc1b9cefe2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:43.151949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58717e-8914-4f57-93ab-59dc1b9cefe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:43.170111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2d58717e-8914-4f57-93ab-59dc1b9cefe2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:01:43.171276 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2d58717e-8914-4f57-93ab-59dc1b9cefe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:01:43.234788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 640/1303] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:01:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:01:43.257626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800ed1-5932-4b2b-8e08-6afbf5790b95 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:43.350887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:43.357766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800ed1-5932-4b2b-8e08-6afbf5790b95 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:43.390366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:43.390979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:43.391253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:43.391547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:43.392123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:43.393492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:01:43.402604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:01:43.403832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Aug 10 08:01:43.404716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 664/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 08:01:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:01:43.410425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58717e-8914-4f57-93ab-59dc1b9cefe2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:43.485487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:43.508717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58717e-8914-4f57-93ab-59dc1b9cefe2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:43.542794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba22a-7a12-4eb2-a0a7-389f993c4935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:43.543395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba22a-7a12-4eb2-a0a7-389f993c4935 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:43.543706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba22a-7a12-4eb2-a0a7-389f993c4935 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:43.543980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba22a-7a12-4eb2-a0a7-389f993c4935 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:43.544604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ba22a-7a12-4eb2-a0a7-389f993c4935 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:01:43.544905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ba22a-7a12-4eb2-a0a7-389f993c4935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:43.546279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ba22a-7a12-4eb2-a0a7-389f993c4935 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:43.551398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 641/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 08:01:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:01:43.557454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:01:43.655161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da128827-5112-460c-a1cf-01f75ce611a5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:01:43.687977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef19e0c-bb31-4a1b-9059-bb23dd244a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:01:43.688560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19e0c-bb31-4a1b-9059-bb23dd244a98 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:01:43.688834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19e0c-bb31-4a1b-9059-bb23dd244a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:01:43.689098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19e0c-bb31-4a1b-9059-bb23dd244a98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:01:43.689749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef19e0c-bb31-4a1b-9059-bb23dd244a98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:01:43.691119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef19e0c-bb31-4a1b-9059-bb23dd244a98 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:01:43.710337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 665/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:01:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:01:53.548361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=30 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:01:53.705664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:46.740819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dccef-a0ce-4579-8915-5dda25cfe11e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:46.741364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dccef-a0ce-4579-8915-5dda25cfe11e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:46.741364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dccef-a0ce-4579-8915-5dda25cfe11e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:46.746360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 642/1307] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:02:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:02:46.747687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a4379-c96b-45af-8b8e-457ba7f7e982 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:46.748120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a4379-c96b-45af-8b8e-457ba7f7e982 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:46.748232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a4379-c96b-45af-8b8e-457ba7f7e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:46.846577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-148a4379-c96b-45af-8b8e-457ba7f7e982 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:02:46.847956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-148a4379-c96b-45af-8b8e-457ba7f7e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:46.972768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 666/1308] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:02:47.028307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500505a-e6e1-4396-a328-b9d375fa80e8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:47.028675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500505a-e6e1-4396-a328-b9d375fa80e8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:47.029014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500505a-e6e1-4396-a328-b9d375fa80e8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:47.030942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 643/1309] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 10 08:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:02:47.037755 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06a43-961b-445b-ad13-10340f115d77 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:47.038045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06a43-961b-445b-ad13-10340f115d77 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:47.038322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06a43-961b-445b-ad13-10340f115d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:47.121647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4ba06a43-961b-445b-ad13-10340f115d77 None None] MFA Rules not processed for user `465160a7e1c24601b83be37681ef322d`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:02:47.122851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4ba06a43-961b-445b-ad13-10340f115d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:47.145321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:47.218536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 667/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 10 08:02:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:02:47.228679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500505a-e6e1-4396-a328-b9d375fa80e8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:02:47.230955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0500505a-e6e1-4396-a328-b9d375fa80e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:47.391538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500505a-e6e1-4396-a328-b9d375fa80e8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:02:47.491047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5383b-d12a-4484-88d1-f05652bc3992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:02:47.491793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5383b-d12a-4484-88d1-f05652bc3992 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:47.492151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5383b-d12a-4484-88d1-f05652bc3992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:47.492494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5383b-d12a-4484-88d1-f05652bc3992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:47.494188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1fb5383b-d12a-4484-88d1-f05652bc3992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:47.562799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:47.620330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5383b-d12a-4484-88d1-f05652bc3992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:02:47.621948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5383b-d12a-4484-88d1-f05652bc3992 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:02:47.642084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 644/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:02:49.918008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621838d-55ab-447f-9e3f-c7970edd2b5e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:49.918547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621838d-55ab-447f-9e3f-c7970edd2b5e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:49.918547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621838d-55ab-447f-9e3f-c7970edd2b5e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:49.920219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 668/1312] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:02:49.926223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14d14-84a3-4a0c-a5a1-a86222fa2396 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:49.926768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14d14-84a3-4a0c-a5a1-a86222fa2396 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:49.927137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14d14-84a3-4a0c-a5a1-a86222fa2396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:50.003837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c8c14d14-84a3-4a0c-a5a1-a86222fa2396 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:02:50.005307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c8c14d14-84a3-4a0c-a5a1-a86222fa2396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:50.120670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 645/1313] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:02:50.160516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621838d-55ab-447f-9e3f-c7970edd2b5e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:02:50.162127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2621838d-55ab-447f-9e3f-c7970edd2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:50.277976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621838d-55ab-447f-9e3f-c7970edd2b5e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:02:50.358954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:50.362833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f6ae-d18d-4d19-82bc-99a44f3fa4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:02:50.364128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f6ae-d18d-4d19-82bc-99a44f3fa4dc service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:50.364793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f6ae-d18d-4d19-82bc-99a44f3fa4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:50.365306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f6ae-d18d-4d19-82bc-99a44f3fa4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:50.367886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1c53f6ae-d18d-4d19-82bc-99a44f3fa4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:50.482553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f6ae-d18d-4d19-82bc-99a44f3fa4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:02:50.484259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f6ae-d18d-4d19-82bc-99a44f3fa4dc service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:02:50.505216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 669/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:02:52.834073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450654e-92e7-4e45-bba3-26f0c2507fb7 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:52.834624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450654e-92e7-4e45-bba3-26f0c2507fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:52.834742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450654e-92e7-4e45-bba3-26f0c2507fb7 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:52.836096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 646/1315] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:02:52.841238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2db0-6948-4c0f-9fec-143d9272269e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:52.841723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2db0-6948-4c0f-9fec-143d9272269e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:52.841818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2db0-6948-4c0f-9fec-143d9272269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:52.907493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c93e2db0-6948-4c0f-9fec-143d9272269e None None] MFA Rules not processed for user `c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:02:52.909507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c93e2db0-6948-4c0f-9fec-143d9272269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:52.960852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:53.009106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 670/1316] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:02:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:02:53.053343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450654e-92e7-4e45-bba3-26f0c2507fb7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:02:53.054870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a450654e-92e7-4e45-bba3-26f0c2507fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:53.064682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:53.162200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450654e-92e7-4e45-bba3-26f0c2507fb7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:02:53.234767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e0a7-9a20-49f4-99a0-c37ff029d09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:02:53.235363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e0a7-9a20-49f4-99a0-c37ff029d09a service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:53.235670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e0a7-9a20-49f4-99a0-c37ff029d09a service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:53.235937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e0a7-9a20-49f4-99a0-c37ff029d09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:53.237536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b7a4e0a7-9a20-49f4-99a0-c37ff029d09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:53.299343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:53.348494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e0a7-9a20-49f4-99a0-c37ff029d09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:02:53.349937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e0a7-9a20-49f4-99a0-c37ff029d09a service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:02:53.368202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 647/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:02:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:02:55.963600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcafc8-da5d-4010-8089-8f08b22541e3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:55.964144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcafc8-da5d-4010-8089-8f08b22541e3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:55.964144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcafc8-da5d-4010-8089-8f08b22541e3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:55.965516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 671/1318] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:02:55.970616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66ccf-11c3-4071-86a9-322133a247a8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:55.971023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66ccf-11c3-4071-86a9-322133a247a8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:55.971261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66ccf-11c3-4071-86a9-322133a247a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:56.039293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-eeb66ccf-11c3-4071-86a9-322133a247a8 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:02:56.040513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-eeb66ccf-11c3-4071-86a9-322133a247a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:56.136662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 648/1319] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:02:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:02:56.189995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce82ae-da2e-434b-bb21-4bd68937c454 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:56.190271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce82ae-da2e-434b-bb21-4bd68937c454 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:56.190542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce82ae-da2e-434b-bb21-4bd68937c454 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:56.191919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 672/1320] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 10 08:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:02:56.197582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4658-edb5-4267-b7c8-f33351622772 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:56.197853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4658-edb5-4267-b7c8-f33351622772 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:56.198123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4658-edb5-4267-b7c8-f33351622772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:56.219870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:56.273311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9ded4658-edb5-4267-b7c8-f33351622772 None None] MFA Rules not processed for user `465160a7e1c24601b83be37681ef322d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:02:56.274510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9ded4658-edb5-4267-b7c8-f33351622772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:56.349944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 649/1321] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 10 08:02:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:02:56.358771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce82ae-da2e-434b-bb21-4bd68937c454 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:02:56.360353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4bce82ae-da2e-434b-bb21-4bd68937c454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:56.462749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce82ae-da2e-434b-bb21-4bd68937c454 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:02:56.537957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad996f1-52a0-4439-b071-17a998363f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:02:56.538559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad996f1-52a0-4439-b071-17a998363f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:56.538833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad996f1-52a0-4439-b071-17a998363f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:56.539100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad996f1-52a0-4439-b071-17a998363f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:56.540762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4ad996f1-52a0-4439-b071-17a998363f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:56.548043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:02:56.649131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad996f1-52a0-4439-b071-17a998363f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:02:56.650563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad996f1-52a0-4439-b071-17a998363f6f service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:02:56.669337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 673/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:02:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:02:59.837567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534ad5-172b-4048-bbf4-fb42a552413c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:59.838098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534ad5-172b-4048-bbf4-fb42a552413c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:59.838206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534ad5-172b-4048-bbf4-fb42a552413c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:59.839998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 650/1323] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:02:59.845328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2399c7-220d-45dc-ad95-87f9cf0c3e5f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:02:59.845998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2399c7-220d-45dc-ad95-87f9cf0c3e5f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:02:59.845998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2399c7-220d-45dc-ad95-87f9cf0c3e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:02:59.916899 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3d2399c7-220d-45dc-ad95-87f9cf0c3e5f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:02:59.918259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3d2399c7-220d-45dc-ad95-87f9cf0c3e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:02:59.981738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:00.028543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 674/1324] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:00.066279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534ad5-172b-4048-bbf4-fb42a552413c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:00.067878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a5534ad5-172b-4048-bbf4-fb42a552413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:00.176348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534ad5-172b-4048-bbf4-fb42a552413c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:00.188639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:00.252192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f9f8-f62e-4f07-879a-bbd03b81b248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:00.252793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f9f8-f62e-4f07-879a-bbd03b81b248 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:00.253071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f9f8-f62e-4f07-879a-bbd03b81b248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:00.253344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f9f8-f62e-4f07-879a-bbd03b81b248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:00.254939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6926f9f8-f62e-4f07-879a-bbd03b81b248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:00.365496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f9f8-f62e-4f07-879a-bbd03b81b248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:00.366863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f9f8-f62e-4f07-879a-bbd03b81b248 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:00.384466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 651/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:02.537052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516d89-55fb-4250-b168-1b5c8159b61b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:02.537664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516d89-55fb-4250-b168-1b5c8159b61b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:02.537993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516d89-55fb-4250-b168-1b5c8159b61b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:02.539378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 675/1326] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:02.545485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401587-2f31-48e9-aa18-9548870fb142 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:02.546000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401587-2f31-48e9-aa18-9548870fb142 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:02.546000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401587-2f31-48e9-aa18-9548870fb142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:02.612782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:02.633652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9c401587-2f31-48e9-aa18-9548870fb142 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:02.634857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9c401587-2f31-48e9-aa18-9548870fb142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:02.731278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 652/1327] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:02.767949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516d89-55fb-4250-b168-1b5c8159b61b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:02.769464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2d516d89-55fb-4250-b168-1b5c8159b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:02.883739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516d89-55fb-4250-b168-1b5c8159b61b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:02.959422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da5aa6-5092-4e6d-bbe3-e3e19205d481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:02.960031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da5aa6-5092-4e6d-bbe3-e3e19205d481 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:02.960302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da5aa6-5092-4e6d-bbe3-e3e19205d481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:02.960567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da5aa6-5092-4e6d-bbe3-e3e19205d481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:02.962133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f6da5aa6-5092-4e6d-bbe3-e3e19205d481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:02.979304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:03.083665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da5aa6-5092-4e6d-bbe3-e3e19205d481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:03.085112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da5aa6-5092-4e6d-bbe3-e3e19205d481 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:03.104345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 676/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:05.207320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b1fa-3d65-4701-baff-5c2aa499b564 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:05.207911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b1fa-3d65-4701-baff-5c2aa499b564 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:05.207911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b1fa-3d65-4701-baff-5c2aa499b564 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:05.209238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 653/1329] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:05.214434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754be2a-3b52-485d-8ea3-ae517e949689 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:05.214837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754be2a-3b52-485d-8ea3-ae517e949689 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:05.215090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754be2a-3b52-485d-8ea3-ae517e949689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:05.281779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8754be2a-3b52-485d-8ea3-ae517e949689 None None] MFA Rules not processed for user `c11b1bfb3e5a4eeeaadb8ad0c3b0c4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:05.283682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8754be2a-3b52-485d-8ea3-ae517e949689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:05.350388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:05.386113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 677/1330] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:05.424526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3b1fa-3d65-4701-baff-5c2aa499b564 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:05.426044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-30b3b1fa-3d65-4701-baff-5c2aa499b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:05.529258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3b1fa-3d65-4701-baff-5c2aa499b564 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:05.550386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:05.609227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98780544-8302-4276-a483-3a5be718f5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:05.609832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98780544-8302-4276-a483-3a5be718f5ad service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:05.610103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98780544-8302-4276-a483-3a5be718f5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:05.610394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98780544-8302-4276-a483-3a5be718f5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:05.612153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-98780544-8302-4276-a483-3a5be718f5ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:05.719159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98780544-8302-4276-a483-3a5be718f5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:05.720651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98780544-8302-4276-a483-3a5be718f5ad service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:05.742169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 654/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:08.034140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437631f-de35-4e5b-ab22-9975745cbc4e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:08.034735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437631f-de35-4e5b-ab22-9975745cbc4e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:08.034735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437631f-de35-4e5b-ab22-9975745cbc4e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:08.036024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 678/1332] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:08.040989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a22-4cdb-4000-9c3c-ff273491097e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:08.041404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a22-4cdb-4000-9c3c-ff273491097e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:08.041536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a22-4cdb-4000-9c3c-ff273491097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:08.103637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:08.106088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0cf65a22-4cdb-4000-9c3c-ff273491097e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:08.107865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0cf65a22-4cdb-4000-9c3c-ff273491097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:08.205915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 655/1333] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:08.241936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437631f-de35-4e5b-ab22-9975745cbc4e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:08.243509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1437631f-de35-4e5b-ab22-9975745cbc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:08.345357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437631f-de35-4e5b-ab22-9975745cbc4e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:08.418888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a901df9-c50e-48a0-8db0-99553e8e2c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:08.419519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a901df9-c50e-48a0-8db0-99553e8e2c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:08.419800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a901df9-c50e-48a0-8db0-99553e8e2c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:08.420069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a901df9-c50e-48a0-8db0-99553e8e2c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:08.421662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3a901df9-c50e-48a0-8db0-99553e8e2c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:08.449675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:08.536275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a901df9-c50e-48a0-8db0-99553e8e2c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:08.537709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a901df9-c50e-48a0-8db0-99553e8e2c39 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:08.558555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 679/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:10.607304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a061-1b38-4b3a-af71-c00a6c3ef8f6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:10.607873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a061-1b38-4b3a-af71-c00a6c3ef8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:10.607873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a061-1b38-4b3a-af71-c00a6c3ef8f6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:10.609141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 656/1335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:10.614474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96236057-cc4e-45df-a19f-8f75ebd2c502 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:10.614917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96236057-cc4e-45df-a19f-8f75ebd2c502 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:10.615029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96236057-cc4e-45df-a19f-8f75ebd2c502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:10.680098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-96236057-cc4e-45df-a19f-8f75ebd2c502 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:10.681293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-96236057-cc4e-45df-a19f-8f75ebd2c502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:10.755481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:10.778968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 680/1336] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:10.823071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9a061-1b38-4b3a-af71-c00a6c3ef8f6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:10.824638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-49c9a061-1b38-4b3a-af71-c00a6c3ef8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:10.928075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9a061-1b38-4b3a-af71-c00a6c3ef8f6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:10.956273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:11.001800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b0d9-982b-4465-8ba2-ff0cd9c7123a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:11.002487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b0d9-982b-4465-8ba2-ff0cd9c7123a service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:11.002879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b0d9-982b-4465-8ba2-ff0cd9c7123a service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:11.003218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b0d9-982b-4465-8ba2-ff0cd9c7123a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:11.005492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9360b0d9-982b-4465-8ba2-ff0cd9c7123a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:11.114599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b0d9-982b-4465-8ba2-ff0cd9c7123a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:11.116072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b0d9-982b-4465-8ba2-ff0cd9c7123a service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:11.133560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 657/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:13.524095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4281-d97f-46d6-bdee-6fc812f1714c None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:13.524677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4281-d97f-46d6-bdee-6fc812f1714c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:13.524677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4281-d97f-46d6-bdee-6fc812f1714c None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:13.525959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 681/1338] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:13.530978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131330e-b75c-4234-b273-3e6fec2d208b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:13.531447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131330e-b75c-4234-b273-3e6fec2d208b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:13.531591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131330e-b75c-4234-b273-3e6fec2d208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:13.602602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3131330e-b75c-4234-b273-3e6fec2d208b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:13.603792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3131330e-b75c-4234-b273-3e6fec2d208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:13.612085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:13.698944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 658/1339] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:13.735548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b4281-d97f-46d6-bdee-6fc812f1714c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:13.737153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2e7b4281-d97f-46d6-bdee-6fc812f1714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:13.847658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b4281-d97f-46d6-bdee-6fc812f1714c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:13.920891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1112b-6136-43f2-b8c4-742acf1c07fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:13.921408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1112b-6136-43f2-b8c4-742acf1c07fc service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:13.921936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1112b-6136-43f2-b8c4-742acf1c07fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:13.922205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1112b-6136-43f2-b8c4-742acf1c07fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:13.923864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3fb1112b-6136-43f2-b8c4-742acf1c07fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:13.959738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:14.036299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1112b-6136-43f2-b8c4-742acf1c07fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:14.037729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1112b-6136-43f2-b8c4-742acf1c07fc service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:14.057849 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 682/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:17.993117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ca38-3e6a-4347-99b6-91a8f5119b79 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:17.993677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ca38-3e6a-4347-99b6-91a8f5119b79 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:17.993677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ca38-3e6a-4347-99b6-91a8f5119b79 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:17.994976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 659/1341] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:18.000471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba6c0-9bc2-448c-8800-87a1a51fecd0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:18.001010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba6c0-9bc2-448c-8800-87a1a51fecd0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:18.001160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba6c0-9bc2-448c-8800-87a1a51fecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:18.068760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8fbba6c0-9bc2-448c-8800-87a1a51fecd0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:18.069977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8fbba6c0-9bc2-448c-8800-87a1a51fecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:18.156229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:18.168433 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 683/1342] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:03:18.207890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01ca38-3e6a-4347-99b6-91a8f5119b79 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:18.209403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0c01ca38-3e6a-4347-99b6-91a8f5119b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:18.314185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01ca38-3e6a-4347-99b6-91a8f5119b79 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:18.354121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:18.395858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7404d03-add1-4ce5-a27c-15388194871d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:18.396465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404d03-add1-4ce5-a27c-15388194871d service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:18.396743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404d03-add1-4ce5-a27c-15388194871d service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:18.397010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404d03-add1-4ce5-a27c-15388194871d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:18.398610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b7404d03-add1-4ce5-a27c-15388194871d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:18.511924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7404d03-add1-4ce5-a27c-15388194871d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:18.513363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7404d03-add1-4ce5-a27c-15388194871d service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:18.533273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 660/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:21.272706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079374a7-605c-4863-9879-b205d25d7dc0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:21.273264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079374a7-605c-4863-9879-b205d25d7dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:21.273264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079374a7-605c-4863-9879-b205d25d7dc0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:21.274608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 684/1344] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:21.280273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4092-090e-4422-bb80-f2760ccffb9b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:21.280786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4092-090e-4422-bb80-f2760ccffb9b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:21.280786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4092-090e-4422-bb80-f2760ccffb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:21.351769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-545f4092-090e-4422-bb80-f2760ccffb9b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:21.353047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-545f4092-090e-4422-bb80-f2760ccffb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:21.371221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:21.451610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 661/1345] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:21.490241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079374a7-605c-4863-9879-b205d25d7dc0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:21.491925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-079374a7-605c-4863-9879-b205d25d7dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:21.597551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079374a7-605c-4863-9879-b205d25d7dc0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:21.669522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7352-0dce-4ae5-a19b-4806984784cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:21.670123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7352-0dce-4ae5-a19b-4806984784cb service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:21.670396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7352-0dce-4ae5-a19b-4806984784cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:21.670662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7352-0dce-4ae5-a19b-4806984784cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:21.672283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-59ed7352-0dce-4ae5-a19b-4806984784cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:21.714930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:21.780592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7352-0dce-4ae5-a19b-4806984784cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:21.782719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7352-0dce-4ae5-a19b-4806984784cb service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:21.800674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 685/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:25.784685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4104c-edc9-47ef-a866-6a22583b10cf None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:25.785242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4104c-edc9-47ef-a866-6a22583b10cf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:25.785242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4104c-edc9-47ef-a866-6a22583b10cf None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:25.786567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 662/1347] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:03:25.791723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8a654-e15f-4548-af01-590316b53acf None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:25.792147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8a654-e15f-4548-af01-590316b53acf None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:25.792263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8a654-e15f-4548-af01-590316b53acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:25.857748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-79b8a654-e15f-4548-af01-590316b53acf None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:25.858881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-79b8a654-e15f-4548-af01-590316b53acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:25.960771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:25.964490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 686/1348] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:26.005165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4104c-edc9-47ef-a866-6a22583b10cf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:26.006742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-72a4104c-edc9-47ef-a866-6a22583b10cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.137045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4104c-edc9-47ef-a866-6a22583b10cf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:26.190053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:26.220515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd570db-9064-40a4-802d-e514518b2f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:26.221123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd570db-9064-40a4-802d-e514518b2f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:26.221393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd570db-9064-40a4-802d-e514518b2f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:26.221654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd570db-9064-40a4-802d-e514518b2f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:26.223286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6fd570db-9064-40a4-802d-e514518b2f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:26.342908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd570db-9064-40a4-802d-e514518b2f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:26.345001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd570db-9064-40a4-802d-e514518b2f09 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:26.364448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 663/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:31.356030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ce3a-04b4-4f6b-8c76-520448f9a6f0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:31.356481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ce3a-04b4-4f6b-8c76-520448f9a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:31.356580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ce3a-04b4-4f6b-8c76-520448f9a6f0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:31.357933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 687/1350] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:31.364613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73f76-97fe-4aa4-adbf-c9024231dccd None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:31.365081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73f76-97fe-4aa4-adbf-c9024231dccd None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:31.365180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73f76-97fe-4aa4-adbf-c9024231dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:31.487632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-18f73f76-97fe-4aa4-adbf-c9024231dccd None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:31.487632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-18f73f76-97fe-4aa4-adbf-c9024231dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:31.516585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:31.620434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 664/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:03:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:35.857671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc3f9e-e601-4f7d-a94f-d94508a53227 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:35.858608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc3f9e-e601-4f7d-a94f-d94508a53227 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:35.858944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc3f9e-e601-4f7d-a94f-d94508a53227 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:35.860977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 688/1352] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:35.866226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3c2f-552f-4397-9c9c-9abf8778dd43 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:35.866669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3c2f-552f-4397-9c9c-9abf8778dd43 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:35.869477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3c2f-552f-4397-9c9c-9abf8778dd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:35.960975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9b9e3c2f-552f-4397-9c9c-9abf8778dd43 None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:35.962207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9b9e3c2f-552f-4397-9c9c-9abf8778dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:36.038164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:36.077305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 665/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:03:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:37.520637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc21bf-f2d7-4abf-beb9-445ee06d48ad None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:37.521376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc21bf-f2d7-4abf-beb9-445ee06d48ad None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:37.521376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc21bf-f2d7-4abf-beb9-445ee06d48ad None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:37.522528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 689/1354] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:37.528345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bb27-043c-47f3-b93b-0f8ccf3b8335 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:37.528829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bb27-043c-47f3-b93b-0f8ccf3b8335 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:37.529168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bb27-043c-47f3-b93b-0f8ccf3b8335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:37.607801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a612bb27-043c-47f3-b93b-0f8ccf3b8335 None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:37.608922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a612bb27-043c-47f3-b93b-0f8ccf3b8335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:37.713474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 666/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:03:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:41.174980 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0552b6-1cde-4392-b930-5ba5b98ecf44 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.175579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0552b6-1cde-4392-b930-5ba5b98ecf44 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.176152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0552b6-1cde-4392-b930-5ba5b98ecf44 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.179091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 690/1356] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:41.183562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c56a-e5c3-47dc-aaa0-f0c6d8321e02 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.184487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c56a-e5c3-47dc-aaa0-f0c6d8321e02 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.185023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c56a-e5c3-47dc-aaa0-f0c6d8321e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.237580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:41.274166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5ba1c56a-e5c3-47dc-aaa0-f0c6d8321e02 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:41.275353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5ba1c56a-e5c3-47dc-aaa0-f0c6d8321e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.391591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 667/1357] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:41.453647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314dcfc-924a-41fd-8185-15962123b344 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.454110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314dcfc-924a-41fd-8185-15962123b344 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.454454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314dcfc-924a-41fd-8185-15962123b344 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.456358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 691/1358] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 08:03:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:41.469878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d388f3-0158-43a9-b051-860b73a30e14 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.470246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d388f3-0158-43a9-b051-860b73a30e14 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.470593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d388f3-0158-43a9-b051-860b73a30e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.553141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-28d388f3-0158-43a9-b051-860b73a30e14 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:41.554434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-28d388f3-0158-43a9-b051-860b73a30e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.606001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:41.685235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 668/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 08:03:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:41.693745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314dcfc-924a-41fd-8185-15962123b344 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:41.695609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1314dcfc-924a-41fd-8185-15962123b344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:41.852598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314dcfc-924a-41fd-8185-15962123b344 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:41.928815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:41.971930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc7edd-a5a8-42df-8889-022305b1d691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:41.972452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc7edd-a5a8-42df-8889-022305b1d691 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:41.972725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc7edd-a5a8-42df-8889-022305b1d691 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:41.972993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc7edd-a5a8-42df-8889-022305b1d691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:41.974571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-33cc7edd-a5a8-42df-8889-022305b1d691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:42.069312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc7edd-a5a8-42df-8889-022305b1d691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:42.071131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc7edd-a5a8-42df-8889-022305b1d691 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:42.091582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 692/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:03:44.365243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29efb0-958f-4e06-8258-4f8986d49dcb None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.365796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29efb0-958f-4e06-8258-4f8986d49dcb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.365796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29efb0-958f-4e06-8258-4f8986d49dcb None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.367226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 669/1361] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:44.372590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7cb9-fbb3-4940-82e7-baf229efb4d9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.373014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7cb9-fbb3-4940-82e7-baf229efb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.373187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7cb9-fbb3-4940-82e7-baf229efb4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.442825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-50ad7cb9-fbb3-4940-82e7-baf229efb4d9 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:44.444057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-50ad7cb9-fbb3-4940-82e7-baf229efb4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.483575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:44.556789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 693/1362] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:44.604261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29efb0-958f-4e06-8258-4f8986d49dcb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:44.605805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ae29efb0-958f-4e06-8258-4f8986d49dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:44.786369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29efb0-958f-4e06-8258-4f8986d49dcb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:44.797234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:44.957629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c911cd1-0b21-446f-ad60-554cc5aeb5f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:44.958234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911cd1-0b21-446f-ad60-554cc5aeb5f8 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:44.958620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911cd1-0b21-446f-ad60-554cc5aeb5f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:44.958888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911cd1-0b21-446f-ad60-554cc5aeb5f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:44.960746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6c911cd1-0b21-446f-ad60-554cc5aeb5f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:45.059978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c911cd1-0b21-446f-ad60-554cc5aeb5f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:45.061575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c911cd1-0b21-446f-ad60-554cc5aeb5f8 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:45.081377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 670/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:47.442046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc10f7-da2a-47d3-9285-be7601b35fab None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:47.442472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc10f7-da2a-47d3-9285-be7601b35fab None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:47.442645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc10f7-da2a-47d3-9285-be7601b35fab None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:47.444274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 694/1364] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:47.450523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b678a-ff43-46d3-92ca-a8261c26a200 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:47.451002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b678a-ff43-46d3-92ca-a8261c26a200 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:47.451101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b678a-ff43-46d3-92ca-a8261c26a200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:47.467827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:47.542854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6d7b678a-ff43-46d3-92ca-a8261c26a200 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:47.544153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6d7b678a-ff43-46d3-92ca-a8261c26a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:47.660410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 671/1365] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:47.702058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166fefc-2e49-4aac-9636-9b64a4c28534 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:47.702341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166fefc-2e49-4aac-9636-9b64a4c28534 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:47.702705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166fefc-2e49-4aac-9636-9b64a4c28534 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:47.705231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 695/1366] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 08:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:47.710574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e579fb2-3be0-49cb-95d8-ecb96f24c7cf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:47.710859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e579fb2-3be0-49cb-95d8-ecb96f24c7cf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:47.711131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e579fb2-3be0-49cb-95d8-ecb96f24c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:47.792430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3e579fb2-3be0-49cb-95d8-ecb96f24c7cf None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:47.793636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3e579fb2-3be0-49cb-95d8-ecb96f24c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:47.832112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:47.920753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 672/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 08:03:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:47.930029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166fefc-2e49-4aac-9636-9b64a4c28534 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:47.932240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1166fefc-2e49-4aac-9636-9b64a4c28534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:48.101646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166fefc-2e49-4aac-9636-9b64a4c28534 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:48.123181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:48.231365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320db0f-288c-43ae-ad19-f24046f7dea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:48.231911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320db0f-288c-43ae-ad19-f24046f7dea8 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:48.232182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320db0f-288c-43ae-ad19-f24046f7dea8 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:48.232444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320db0f-288c-43ae-ad19-f24046f7dea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:48.234690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2320db0f-288c-43ae-ad19-f24046f7dea8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:48.338163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320db0f-288c-43ae-ad19-f24046f7dea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:48.340127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320db0f-288c-43ae-ad19-f24046f7dea8 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:48.362742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 696/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:49.422158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008db2-cefb-4f4d-9951-a0272a206592 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.422723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008db2-cefb-4f4d-9951-a0272a206592 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.422723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008db2-cefb-4f4d-9951-a0272a206592 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.424248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 673/1369] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:49.429504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47da56-5ac0-48cc-8e67-01ae6cd6837a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.429931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47da56-5ac0-48cc-8e67-01ae6cd6837a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.430115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47da56-5ac0-48cc-8e67-01ae6cd6837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.464505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:49.502662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-de47da56-5ac0-48cc-8e67-01ae6cd6837a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:49.503903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-de47da56-5ac0-48cc-8e67-01ae6cd6837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:49.610725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 697/1370] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:49.981451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350173c3-857a-4266-8150-c7a4dba05db8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.981451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350173c3-857a-4266-8150-c7a4dba05db8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.981451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350173c3-857a-4266-8150-c7a4dba05db8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:49.982918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 674/1371] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 10 08:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:49.988478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8854dc-2b3f-4dd3-a1d3-237e917a739b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:49.988765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8854dc-2b3f-4dd3-a1d3-237e917a739b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:49.989040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8854dc-2b3f-4dd3-a1d3-237e917a739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.072045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8e8854dc-2b3f-4dd3-a1d3-237e917a739b None None] MFA Rules not processed for user `a3812df0dc174249acb139876f4302ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:50.073267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8e8854dc-2b3f-4dd3-a1d3-237e917a739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.133735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:50.164614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 698/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 10 08:03:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:50.173075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350173c3-857a-4266-8150-c7a4dba05db8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.174656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-350173c3-857a-4266-8150-c7a4dba05db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.291517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350173c3-857a-4266-8150-c7a4dba05db8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:50.337863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:50.376497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:50.377211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.377559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.377821 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.379468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.502922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af0e9-dfeb-4440-850b-4d530ab6f05e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.503396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af0e9-dfeb-4440-850b-4d530ab6f05e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.503520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af0e9-dfeb-4440-850b-4d530ab6f05e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.504818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 699/1373] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:03:50.506396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:50.508103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:50.511541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272004d5-4658-4c00-b190-fe6753068080 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:50.512140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272004d5-4658-4c00-b190-fe6753068080 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:50.512834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272004d5-4658-4c00-b190-fe6753068080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:50.530983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 675/1374] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:03:50.717354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-272004d5-4658-4c00-b190-fe6753068080 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:50.719581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-272004d5-4658-4c00-b190-fe6753068080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.846040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 700/1375] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:03:50.891126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:50.892503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:50.963820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:50.997730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9811e-a3cd-471e-aced-39b821f5db86 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:51.111806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e797-8fc4-4b12-b410-a6f3ff350a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:51.112320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e797-8fc4-4b12-b410-a6f3ff350a4d service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:51.112593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e797-8fc4-4b12-b410-a6f3ff350a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:51.112862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e797-8fc4-4b12-b410-a6f3ff350a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:51.114466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-79a3e797-8fc4-4b12-b410-a6f3ff350a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:51.192222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:51.204164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e797-8fc4-4b12-b410-a6f3ff350a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:51.205826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e797-8fc4-4b12-b410-a6f3ff350a4d service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:51.224909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 676/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:53.341894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0292-d129-4b05-b5a3-0615b9720947 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.342419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0292-d129-4b05-b5a3-0615b9720947 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.342419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0292-d129-4b05-b5a3-0615b9720947 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.343771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 701/1377] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:53.348846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c7ad-59c3-4a2a-8999-01ecefd923e1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.349298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c7ad-59c3-4a2a-8999-01ecefd923e1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.349398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c7ad-59c3-4a2a-8999-01ecefd923e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.419937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a1c3c7ad-59c3-4a2a-8999-01ecefd923e1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:53.421770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a1c3c7ad-59c3-4a2a-8999-01ecefd923e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:53.534177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 677/1378] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:53.587134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f0292-d129-4b05-b5a3-0615b9720947 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:53.587134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f49f0292-d129-4b05-b5a3-0615b9720947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:53.638169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:53.739264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f0292-d129-4b05-b5a3-0615b9720947 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:53.866420 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768567ee-e181-40ba-b343-dcd12b8e0dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:53.867028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768567ee-e181-40ba-b343-dcd12b8e0dc1 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:53.867303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768567ee-e181-40ba-b343-dcd12b8e0dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:53.867598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768567ee-e181-40ba-b343-dcd12b8e0dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:53.869192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-768567ee-e181-40ba-b343-dcd12b8e0dc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:53.881468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:53.990134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768567ee-e181-40ba-b343-dcd12b8e0dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:53.992618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768567ee-e181-40ba-b343-dcd12b8e0dc1 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:54.018452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 702/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:56.489940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069787fc-7805-461e-827e-3cbb16d91585 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.490547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069787fc-7805-461e-827e-3cbb16d91585 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.490635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069787fc-7805-461e-827e-3cbb16d91585 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.492578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 678/1380] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:56.499065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a482d-e690-46b9-8363-62686eb0562a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:56.499656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a482d-e690-46b9-8363-62686eb0562a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:56.499656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a482d-e690-46b9-8363-62686eb0562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:56.570178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-326a482d-e690-46b9-8363-62686eb0562a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:56.571364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-326a482d-e690-46b9-8363-62686eb0562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.663140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:56.677787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 703/1381] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:56.726028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069787fc-7805-461e-827e-3cbb16d91585 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:56.727685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-069787fc-7805-461e-827e-3cbb16d91585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:56.801729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:56.902142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069787fc-7805-461e-827e-3cbb16d91585 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:57.034739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9498-36c6-45e0-bd72-31ada0bc4ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:57.035340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9498-36c6-45e0-bd72-31ada0bc4ffa service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:57.035637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9498-36c6-45e0-bd72-31ada0bc4ffa service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:57.035903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9498-36c6-45e0-bd72-31ada0bc4ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:57.038167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-825f9498-36c6-45e0-bd72-31ada0bc4ffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:57.061885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:57.143163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9498-36c6-45e0-bd72-31ada0bc4ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:57.144920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9498-36c6-45e0-bd72-31ada0bc4ffa service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:57.165115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 679/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:03:59.249886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63831d-bcbe-46cb-b65a-4e19442baef7 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.250409 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63831d-bcbe-46cb-b65a-4e19442baef7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.250409 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63831d-bcbe-46cb-b65a-4e19442baef7 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.251714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 704/1383] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:03:59.257128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0243a-60b1-49ce-8023-e298a3c9284c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.257711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0243a-60b1-49ce-8023-e298a3c9284c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.257820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0243a-60b1-49ce-8023-e298a3c9284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.328613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-72c0243a-60b1-49ce-8023-e298a3c9284c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:03:59.329830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-72c0243a-60b1-49ce-8023-e298a3c9284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:59.426122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:59.429988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 680/1384] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:03:59.472521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63831d-bcbe-46cb-b65a-4e19442baef7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:03:59.474080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9f63831d-bcbe-46cb-b65a-4e19442baef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:59.629699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63831d-bcbe-46cb-b65a-4e19442baef7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:03:59.705366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:03:59.760788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d2cec-afef-4b9b-990b-2a2358bf147f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:03:59.761442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d2cec-afef-4b9b-990b-2a2358bf147f service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:03:59.761736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d2cec-afef-4b9b-990b-2a2358bf147f service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:03:59.762053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d2cec-afef-4b9b-990b-2a2358bf147f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:03:59.763799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3c8d2cec-afef-4b9b-990b-2a2358bf147f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:03:59.860110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d2cec-afef-4b9b-990b-2a2358bf147f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:03:59.861729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d2cec-afef-4b9b-990b-2a2358bf147f service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:03:59.879914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 705/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:02.040310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7383-6f77-4924-a7a3-60f131ad3ac9 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:02.041000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7383-6f77-4924-a7a3-60f131ad3ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:02.041000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7383-6f77-4924-a7a3-60f131ad3ac9 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:02.042342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 681/1386] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:02.048868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d97c-e2ec-4e9a-a84b-49b9763f91cb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:02.049668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d97c-e2ec-4e9a-a84b-49b9763f91cb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:02.049668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d97c-e2ec-4e9a-a84b-49b9763f91cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:02.133297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cf22d97c-e2ec-4e9a-a84b-49b9763f91cb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:02.134613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cf22d97c-e2ec-4e9a-a84b-49b9763f91cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:02.170181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:02.253478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 706/1387] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:02.306483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7383-6f77-4924-a7a3-60f131ad3ac9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:02.308131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-783c7383-6f77-4924-a7a3-60f131ad3ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:02.488271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7383-6f77-4924-a7a3-60f131ad3ac9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:02.598585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:02.652571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34af652-27cb-4284-bc24-f962270728af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:02.653174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34af652-27cb-4284-bc24-f962270728af service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:02.653551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34af652-27cb-4284-bc24-f962270728af service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:02.653995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34af652-27cb-4284-bc24-f962270728af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:02.656889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c34af652-27cb-4284-bc24-f962270728af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:02.762729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34af652-27cb-4284-bc24-f962270728af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:02.764419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34af652-27cb-4284-bc24-f962270728af service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:02.785561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 682/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:04.828858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418cea2-b35d-47dc-8d36-fa7e07a62011 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:04.829423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418cea2-b35d-47dc-8d36-fa7e07a62011 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:04.829423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418cea2-b35d-47dc-8d36-fa7e07a62011 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:04.830884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 707/1389] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:04.835941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0be7c-dd4d-4ed9-80e5-9aee36fffb43 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:04.836367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0be7c-dd4d-4ed9-80e5-9aee36fffb43 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:04.836464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0be7c-dd4d-4ed9-80e5-9aee36fffb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:04.902052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-69d0be7c-dd4d-4ed9-80e5-9aee36fffb43 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:04.903301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-69d0be7c-dd4d-4ed9-80e5-9aee36fffb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:04.939872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:05.003640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 683/1390] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:05.048537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418cea2-b35d-47dc-8d36-fa7e07a62011 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:05.050114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b418cea2-b35d-47dc-8d36-fa7e07a62011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:05.203931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418cea2-b35d-47dc-8d36-fa7e07a62011 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:05.213263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:05.329067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb862cf-5ff6-4913-928c-a467d7edcb9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:05.329670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb862cf-5ff6-4913-928c-a467d7edcb9f service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:05.329946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb862cf-5ff6-4913-928c-a467d7edcb9f service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:05.330216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb862cf-5ff6-4913-928c-a467d7edcb9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:05.331837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0bb862cf-5ff6-4913-928c-a467d7edcb9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:05.421933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb862cf-5ff6-4913-928c-a467d7edcb9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:05.423519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb862cf-5ff6-4913-928c-a467d7edcb9f service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:05.442800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 708/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:06.059439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1cfb-19d7-4d46-aac3-fc65c708bd25 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:06.060040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1cfb-19d7-4d46-aac3-fc65c708bd25 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:06.060040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1cfb-19d7-4d46-aac3-fc65c708bd25 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:06.062002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 684/1392] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:06.067178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e67b-050b-471c-ad73-708267a1ad26 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:06.067644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e67b-050b-471c-ad73-708267a1ad26 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:06.067765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e67b-050b-471c-ad73-708267a1ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:06.083867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:06.136908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4290e67b-050b-471c-ad73-708267a1ad26 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:06.138123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4290e67b-050b-471c-ad73-708267a1ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.239995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 709/1393] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:06.296157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8833c-52b7-4788-8e95-34ccf2248854 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:06.296444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8833c-52b7-4788-8e95-34ccf2248854 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:06.296720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8833c-52b7-4788-8e95-34ccf2248854 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:06.298180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 685/1394] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 10 08:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:06.305335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb086b-a34c-4941-bca9-cad31fd97330 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:06.305621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb086b-a34c-4941-bca9-cad31fd97330 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:06.305897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb086b-a34c-4941-bca9-cad31fd97330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:06.384933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-69fb086b-a34c-4941-bca9-cad31fd97330 None None] MFA Rules not processed for user `de7826aa1f8e4076ad5656f8cf7fe2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:06.386109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-69fb086b-a34c-4941-bca9-cad31fd97330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.421864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:06.470500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 710/1395] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 10 08:04:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:06.478292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8833c-52b7-4788-8e95-34ccf2248854 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:06.479831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e9b8833c-52b7-4788-8e95-34ccf2248854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.585867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8833c-52b7-4788-8e95-34ccf2248854 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:06.651070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:06.664499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f1216-be28-4158-8b3e-ed175b79e0b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:06.665130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1216-be28-4158-8b3e-ed175b79e0b9 service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:06.665435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1216-be28-4158-8b3e-ed175b79e0b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:06.665702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1216-be28-4158-8b3e-ed175b79e0b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:06.667287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ef6f1216-be28-4158-8b3e-ed175b79e0b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:06.778674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f1216-be28-4158-8b3e-ed175b79e0b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:06.780179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f1216-be28-4158-8b3e-ed175b79e0b9 service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:06.799763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 686/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:07.567165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83138f1-8f9c-4456-ad09-6c7ef517ec08 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.567666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83138f1-8f9c-4456-ad09-6c7ef517ec08 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.567772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83138f1-8f9c-4456-ad09-6c7ef517ec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.591798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb9441-3a38-4d7b-9130-0d42ebaa61cf None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.592352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb9441-3a38-4d7b-9130-0d42ebaa61cf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.592581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb9441-3a38-4d7b-9130-0d42ebaa61cf None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.594176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 687/1397] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:07.599073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af370b-6778-425b-92fd-2ab1627f5c19 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.599357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af370b-6778-425b-92fd-2ab1627f5c19 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.599661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af370b-6778-425b-92fd-2ab1627f5c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.634837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f83138f1-8f9c-4456-ad09-6c7ef517ec08 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:07.636070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f83138f1-8f9c-4456-ad09-6c7ef517ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.667402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c5af370b-6778-425b-92fd-2ab1627f5c19 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:07.668628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c5af370b-6778-425b-92fd-2ab1627f5c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.712296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:07.725064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 711/1398] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:04:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:07.770967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56d84-e200-40b1-9758-1b06eadd3ebc None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.771252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56d84-e200-40b1-9758-1b06eadd3ebc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.771566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56d84-e200-40b1-9758-1b06eadd3ebc None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.772011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 688/1399] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:07.773029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 712/1400] 10.222.0.40 () {54 vars in 943 bytes} [Wed Aug 10 08:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:04:07.779467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20e52e-8b7a-4481-a0e0-3bdca438d3ad None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:07.780358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20e52e-8b7a-4481-a0e0-3bdca438d3ad None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:07.780838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20e52e-8b7a-4481-a0e0-3bdca438d3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:07.820680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56d84-e200-40b1-9758-1b06eadd3ebc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:07.822184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-60d56d84-e200-40b1-9758-1b06eadd3ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.857870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5b20e52e-8b7a-4481-a0e0-3bdca438d3ad None None] MFA Rules not processed for user `666116325de04177accd2bfece858554`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:07.859067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5b20e52e-8b7a-4481-a0e0-3bdca438d3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:07.878547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:07.969218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 689/1401] 10.222.0.40 () {58 vars in 1040 bytes} [Wed Aug 10 08:04:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:07.977392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56d84-e200-40b1-9758-1b06eadd3ebc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:07.978669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20e52e-8b7a-4481-a0e0-3bdca438d3ad None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:07.985510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:07.989936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20e52e-8b7a-4481-a0e0-3bdca438d3ad None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:08.104775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d49a8-dd2d-492c-8cec-d30662dc2d53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.105277 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d49a8-dd2d-492c-8cec-d30662dc2d53 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.105553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d49a8-dd2d-492c-8cec-d30662dc2d53 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.105832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d49a8-dd2d-492c-8cec-d30662dc2d53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.107549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c38d49a8-dd2d-492c-8cec-d30662dc2d53 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.109204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc0d9c-7232-4a48-8f6d-26e63a227a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:08.109884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc0d9c-7232-4a48-8f6d-26e63a227a57 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:08.110170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc0d9c-7232-4a48-8f6d-26e63a227a57 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:08.110465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc0d9c-7232-4a48-8f6d-26e63a227a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:08.112270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1cfc0d9c-7232-4a48-8f6d-26e63a227a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:08.126579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:08.198829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d49a8-dd2d-492c-8cec-d30662dc2d53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.200608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d49a8-dd2d-492c-8cec-d30662dc2d53 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.209489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 690/1402] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:04:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 08:04:08.213570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc0d9c-7232-4a48-8f6d-26e63a227a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:08.215149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc0d9c-7232-4a48-8f6d-26e63a227a57 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:08.236143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 713/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:04:10.345025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c4a4-710c-4cb8-a506-1ab07f21c9cb None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.345589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c4a4-710c-4cb8-a506-1ab07f21c9cb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.345589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c4a4-710c-4cb8-a506-1ab07f21c9cb None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.346844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 691/1404] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:10.352024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb3c2-ee13-45a3-a94e-16400f643089 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.352480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb3c2-ee13-45a3-a94e-16400f643089 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.352591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb3c2-ee13-45a3-a94e-16400f643089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.423208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5ebcb3c2-ee13-45a3-a94e-16400f643089 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:10.424616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5ebcb3c2-ee13-45a3-a94e-16400f643089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.540870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:10.559596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 714/1405] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:10.600860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2c4a4-710c-4cb8-a506-1ab07f21c9cb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:10.602263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f4b2c4a4-710c-4cb8-a506-1ab07f21c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.642474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:10.762669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2c4a4-710c-4cb8-a506-1ab07f21c9cb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:10.885451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:10.893504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77ea2-620d-4553-8d38-cc012d4846b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:10.894110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77ea2-620d-4553-8d38-cc012d4846b2 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:10.894384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77ea2-620d-4553-8d38-cc012d4846b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:10.894650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77ea2-620d-4553-8d38-cc012d4846b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:10.896282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cbe77ea2-620d-4553-8d38-cc012d4846b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:10.995729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77ea2-620d-4553-8d38-cc012d4846b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:10.998003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77ea2-620d-4553-8d38-cc012d4846b2 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:11.023183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 692/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:13.093561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2ba63-4009-4f71-85df-d73363f12f4d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.094142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2ba63-4009-4f71-85df-d73363f12f4d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.094142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2ba63-4009-4f71-85df-d73363f12f4d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.095852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 715/1407] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:13.100641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6c0f-456b-48b3-a0e4-3087633456d3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.101058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6c0f-456b-48b3-a0e4-3087633456d3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.101238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6c0f-456b-48b3-a0e4-3087633456d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.176376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5b3b6c0f-456b-48b3-a0e4-3087633456d3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:13.178206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5b3b6c0f-456b-48b3-a0e4-3087633456d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.245622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:13.285717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 693/1408] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:13.331953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2ba63-4009-4f71-85df-d73363f12f4d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:13.333537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-90b2ba63-4009-4f71-85df-d73363f12f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.501312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2ba63-4009-4f71-85df-d73363f12f4d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:13.570748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:13.628910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c842b-78dd-4dc0-b96e-5b77ecf5ab3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:13.629820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c842b-78dd-4dc0-b96e-5b77ecf5ab3e service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:13.630100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c842b-78dd-4dc0-b96e-5b77ecf5ab3e service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:13.630376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c842b-78dd-4dc0-b96e-5b77ecf5ab3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:13.632049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b63c842b-78dd-4dc0-b96e-5b77ecf5ab3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:13.731369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c842b-78dd-4dc0-b96e-5b77ecf5ab3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:13.733226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c842b-78dd-4dc0-b96e-5b77ecf5ab3e service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:13.753073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 716/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:23.283823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=13 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:23.750501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=67 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:30.608561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0739-83a1-414d-bac1-1869865568ff None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.609078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0739-83a1-414d-bac1-1869865568ff None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.609078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0739-83a1-414d-bac1-1869865568ff None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.610347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 694/1410] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 10 08:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:30.615274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af004d5d-b22d-4c04-bf75-c67184f7e7ed None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.615742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af004d5d-b22d-4c04-bf75-c67184f7e7ed None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.615855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af004d5d-b22d-4c04-bf75-c67184f7e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.692227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-af004d5d-b22d-4c04-bf75-c67184f7e7ed None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:30.693423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-af004d5d-b22d-4c04-bf75-c67184f7e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:30.806005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 717/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 10 08:04:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:30.820763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff667749-0500-45b8-8f1d-bfa801a8c633 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.821045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff667749-0500-45b8-8f1d-bfa801a8c633 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.821320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff667749-0500-45b8-8f1d-bfa801a8c633 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.822625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 695/1412] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 10 08:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:30.827799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02f811-9de6-430a-bae6-89a3244fb864 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:30.828110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02f811-9de6-430a-bae6-89a3244fb864 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:30.828381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02f811-9de6-430a-bae6-89a3244fb864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:30.901062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:30.903730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3c02f811-9de6-430a-bae6-89a3244fb864 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:30.906072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3c02f811-9de6-430a-bae6-89a3244fb864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:31.022673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 718/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 10 08:04:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:04:33.499452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81bd9-8f36-455c-8a5d-c6235cda7f5b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.500030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81bd9-8f36-455c-8a5d-c6235cda7f5b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.500030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81bd9-8f36-455c-8a5d-c6235cda7f5b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.501206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:04:33.506434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613466-831f-4fbb-b4d5-2de654812654 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.506921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613466-831f-4fbb-b4d5-2de654812654 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.507031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613466-831f-4fbb-b4d5-2de654812654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.572029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e7613466-831f-4fbb-b4d5-2de654812654 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:33.573250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e7613466-831f-4fbb-b4d5-2de654812654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:33.628283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:33.671232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:33.715370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b81bd9-8f36-455c-8a5d-c6235cda7f5b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:33.717607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-90b81bd9-8f36-455c-8a5d-c6235cda7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:33.860714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b81bd9-8f36-455c-8a5d-c6235cda7f5b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:33.932578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:33.973528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c4582-c610-4003-901c-fde080236bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:33.974130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4582-c610-4003-901c-fde080236bee service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:33.974406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4582-c610-4003-901c-fde080236bee service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:33.974676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4582-c610-4003-901c-fde080236bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:33.976347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-783c4582-c610-4003-901c-fde080236bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:34.064460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c4582-c610-4003-901c-fde080236bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:34.066060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c4582-c610-4003-901c-fde080236bee service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:34.084131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 697/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:34.981014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b00aa-d71d-4331-9e8d-19c07556fd53 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:34.981593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b00aa-d71d-4331-9e8d-19c07556fd53 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:34.981593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b00aa-d71d-4331-9e8d-19c07556fd53 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:34.982930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:34.987814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaaf08-159b-49b6-93f0-31ca07de5a6a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:34.988282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaaf08-159b-49b6-93f0-31ca07de5a6a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:34.988389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaaf08-159b-49b6-93f0-31ca07de5a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:35.065089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8bcaaf08-159b-49b6-93f0-31ca07de5a6a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:35.066291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8bcaaf08-159b-49b6-93f0-31ca07de5a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:35.093973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:35.172401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:35.329521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b00aa-d71d-4331-9e8d-19c07556fd53 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:35.331051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-aa7b00aa-d71d-4331-9e8d-19c07556fd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:35.476112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b00aa-d71d-4331-9e8d-19c07556fd53 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:35.517752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:35.592262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd602be-b30e-4b1e-833f-faabb7ebc4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:35.592784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd602be-b30e-4b1e-833f-faabb7ebc4b5 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:35.593061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd602be-b30e-4b1e-833f-faabb7ebc4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:35.593327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd602be-b30e-4b1e-833f-faabb7ebc4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:35.594916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ebd602be-b30e-4b1e-833f-faabb7ebc4b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:35.683794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd602be-b30e-4b1e-833f-faabb7ebc4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:35.685529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd602be-b30e-4b1e-833f-faabb7ebc4b5 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:35.703157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 721/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:36.608264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbfa7-d4f5-4f79-8888-386b75ae7415 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:36.608791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbfa7-d4f5-4f79-8888-386b75ae7415 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:36.608791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbfa7-d4f5-4f79-8888-386b75ae7415 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:36.610040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:36.614891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ed21-c5d6-455b-b9f2-b03869fab453 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:36.615283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ed21-c5d6-455b-b9f2-b03869fab453 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:36.615470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ed21-c5d6-455b-b9f2-b03869fab453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:36.669595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:36.691981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-39c9ed21-c5d6-455b-b9f2-b03869fab453 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:36.693187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-39c9ed21-c5d6-455b-b9f2-b03869fab453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:36.788617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:36.939878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fbfa7-d4f5-4f79-8888-386b75ae7415 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:36.941316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-518fbfa7-d4f5-4f79-8888-386b75ae7415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:37.086753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fbfa7-d4f5-4f79-8888-386b75ae7415 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:37.098764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:37.202027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42432d5-d4ce-4193-bd3d-d84648bdbee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:37.202550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42432d5-d4ce-4193-bd3d-d84648bdbee7 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:37.202829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42432d5-d4ce-4193-bd3d-d84648bdbee7 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:37.203099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42432d5-d4ce-4193-bd3d-d84648bdbee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:37.204732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a42432d5-d4ce-4193-bd3d-d84648bdbee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:37.293993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42432d5-d4ce-4193-bd3d-d84648bdbee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:37.296572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42432d5-d4ce-4193-bd3d-d84648bdbee7 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:37.315743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 700/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:38.194112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae30c-7131-4fc4-8aee-12a534c855db None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:38.194721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae30c-7131-4fc4-8aee-12a534c855db None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:38.194721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae30c-7131-4fc4-8aee-12a534c855db None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:38.196030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:38.201549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1120d7-423b-45fd-89e6-8b3642a2c9ff None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:38.202005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1120d7-423b-45fd-89e6-8b3642a2c9ff None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:38.202115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1120d7-423b-45fd-89e6-8b3642a2c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:38.222254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:38.277515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ab1120d7-423b-45fd-89e6-8b3642a2c9ff None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:38.279295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ab1120d7-423b-45fd-89e6-8b3642a2c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:38.378698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:38.535743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae30c-7131-4fc4-8aee-12a534c855db None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:38.537825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-049ae30c-7131-4fc4-8aee-12a534c855db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:38.648174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:38.685463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae30c-7131-4fc4-8aee-12a534c855db None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:38.799517 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727b083-c74a-429f-8135-1c4273f18a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:38.800122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b083-c74a-429f-8135-1c4273f18a4e service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:38.800418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b083-c74a-429f-8135-1c4273f18a4e service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:38.800686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b083-c74a-429f-8135-1c4273f18a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:38.802534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3727b083-c74a-429f-8135-1c4273f18a4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:38.878012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:38.892657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b083-c74a-429f-8135-1c4273f18a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:38.894342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b083-c74a-429f-8135-1c4273f18a4e service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:38.912830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 724/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:39.796291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb77dec-5698-43fe-9968-4627a7f73ee2 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:39.796845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb77dec-5698-43fe-9968-4627a7f73ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:39.796845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb77dec-5698-43fe-9968-4627a7f73ee2 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:39.798169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:39.803431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3ede-0746-498d-8d71-80699b09d174 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:39.803854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3ede-0746-498d-8d71-80699b09d174 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:39.803978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3ede-0746-498d-8d71-80699b09d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:39.878022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-53cd3ede-0746-498d-8d71-80699b09d174 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:39.879222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-53cd3ede-0746-498d-8d71-80699b09d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:39.979603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:40.139605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb77dec-5698-43fe-9968-4627a7f73ee2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:40.141050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2eb77dec-5698-43fe-9968-4627a7f73ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:40.228174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:40.289523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb77dec-5698-43fe-9968-4627a7f73ee2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:40.401764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca69d5-34a8-42ad-a45b-3b67619dc450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:40.402290 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca69d5-34a8-42ad-a45b-3b67619dc450 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:40.402562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca69d5-34a8-42ad-a45b-3b67619dc450 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:40.402827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca69d5-34a8-42ad-a45b-3b67619dc450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:40.405072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-00ca69d5-34a8-42ad-a45b-3b67619dc450 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:40.455705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:40.497696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca69d5-34a8-42ad-a45b-3b67619dc450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:40.499402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca69d5-34a8-42ad-a45b-3b67619dc450 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:40.517746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 703/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:41.349890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a3e2-4277-4bf8-862c-34bd11f34f5c None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:41.350430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a3e2-4277-4bf8-862c-34bd11f34f5c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:41.350430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a3e2-4277-4bf8-862c-34bd11f34f5c None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:41.351838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:04:41.356836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b90f9-07f5-409f-ac0f-d7891ce8398e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:41.357387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b90f9-07f5-409f-ac0f-d7891ce8398e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:41.357699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b90f9-07f5-409f-ac0f-d7891ce8398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:41.432960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-913b90f9-07f5-409f-ac0f-d7891ce8398e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:41.434156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-913b90f9-07f5-409f-ac0f-d7891ce8398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:41.532643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:41.688482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a3e2-4277-4bf8-862c-34bd11f34f5c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:41.689907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d543a3e2-4277-4bf8-862c-34bd11f34f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:41.737859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:41.834268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a3e2-4277-4bf8-862c-34bd11f34f5c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:41.947481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfc9a7-8fd6-453e-8391-6cdddca028f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:41.948000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfc9a7-8fd6-453e-8391-6cdddca028f4 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:41.948275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfc9a7-8fd6-453e-8391-6cdddca028f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:41.948545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfc9a7-8fd6-453e-8391-6cdddca028f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:41.950138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02bfc9a7-8fd6-453e-8391-6cdddca028f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:41.957857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:42.040538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfc9a7-8fd6-453e-8391-6cdddca028f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:42.042140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfc9a7-8fd6-453e-8391-6cdddca028f4 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:42.060382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 727/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:42.867314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ec02-c800-426c-954f-f6e07238e281 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:42.867917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ec02-c800-426c-954f-f6e07238e281 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:42.867917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ec02-c800-426c-954f-f6e07238e281 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:42.869223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:42.874956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434ace-38da-4a7f-8ef9-9fde6695227f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:42.875394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434ace-38da-4a7f-8ef9-9fde6695227f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:42.875564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434ace-38da-4a7f-8ef9-9fde6695227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:42.949138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a7434ace-38da-4a7f-8ef9-9fde6695227f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:42.950327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7434ace-38da-4a7f-8ef9-9fde6695227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.019228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:43.049211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:43.200112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31ec02-c800-426c-954f-f6e07238e281 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:43.201697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6f31ec02-c800-426c-954f-f6e07238e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.219467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:43.348826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31ec02-c800-426c-954f-f6e07238e281 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:43.445723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:43.471881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068a5e-98df-47b7-af72-21a3401c0a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:43.472410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068a5e-98df-47b7-af72-21a3401c0a46 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:43.472680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068a5e-98df-47b7-af72-21a3401c0a46 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:43.472942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068a5e-98df-47b7-af72-21a3401c0a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:43.474521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-15068a5e-98df-47b7-af72-21a3401c0a46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:43.562123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068a5e-98df-47b7-af72-21a3401c0a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:43.563763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068a5e-98df-47b7-af72-21a3401c0a46 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:43.581843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 706/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:44.394833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b6f0-f36d-42a2-9de3-a4576357593f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.395432 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b6f0-f36d-42a2-9de3-a4576357593f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.395432 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b6f0-f36d-42a2-9de3-a4576357593f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.396753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:44.401589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675dce4-19ce-4eff-a665-797697a0ea2a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.402044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675dce4-19ce-4eff-a665-797697a0ea2a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.402160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675dce4-19ce-4eff-a665-797697a0ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.478363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0675dce4-19ce-4eff-a665-797697a0ea2a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:44.479588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0675dce4-19ce-4eff-a665-797697a0ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.520428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:44.578286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:44.732031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b6f0-f36d-42a2-9de3-a4576357593f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:44.734071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5978b6f0-f36d-42a2-9de3-a4576357593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:44.880842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b6f0-f36d-42a2-9de3-a4576357593f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:44.937008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:44.994652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f55a-38d4-4fb4-bfbc-147f46926130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:44.995252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f55a-38d4-4fb4-bfbc-147f46926130 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:44.995552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f55a-38d4-4fb4-bfbc-147f46926130 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:44.995844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f55a-38d4-4fb4-bfbc-147f46926130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:44.997398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e354f55a-38d4-4fb4-bfbc-147f46926130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:45.092860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f55a-38d4-4fb4-bfbc-147f46926130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:45.094430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f55a-38d4-4fb4-bfbc-147f46926130 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:45.112690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 730/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:45.926658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8557c4-034c-4cb7-9ab0-a96a56f86c04 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.927500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8557c4-034c-4cb7-9ab0-a96a56f86c04 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.927500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8557c4-034c-4cb7-9ab0-a96a56f86c04 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:45.928812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:45.933919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9cb0-9558-453d-8f89-15fa419b59f1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:45.934384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9cb0-9558-453d-8f89-15fa419b59f1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:45.934485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9cb0-9558-453d-8f89-15fa419b59f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.011786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2bde9cb0-9558-453d-8f89-15fa419b59f1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:46.013014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2bde9cb0-9558-453d-8f89-15fa419b59f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:46.015392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:46.110985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:46.260499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8557c4-034c-4cb7-9ab0-a96a56f86c04 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:46.261978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-df8557c4-034c-4cb7-9ab0-a96a56f86c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:46.408699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8557c4-034c-4cb7-9ab0-a96a56f86c04 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:46.434823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:46.522277 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7aa5c-31a8-4ee3-abbe-d78f846810e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:46.522790 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7aa5c-31a8-4ee3-abbe-d78f846810e6 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:46.523061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7aa5c-31a8-4ee3-abbe-d78f846810e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:46.523326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7aa5c-31a8-4ee3-abbe-d78f846810e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:46.524947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bca7aa5c-31a8-4ee3-abbe-d78f846810e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:46.614581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7aa5c-31a8-4ee3-abbe-d78f846810e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:46.616224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7aa5c-31a8-4ee3-abbe-d78f846810e6 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:46.633964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 709/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:48.580020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb82f82-3227-4500-bce7-6ee0a2fc06c6 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:48.580554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb82f82-3227-4500-bce7-6ee0a2fc06c6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:48.580554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb82f82-3227-4500-bce7-6ee0a2fc06c6 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:48.581834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:48.587101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e003f0-5dc2-451d-9c51-4841c0df9933 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:48.587553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e003f0-5dc2-451d-9c51-4841c0df9933 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:48.587652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e003f0-5dc2-451d-9c51-4841c0df9933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:48.629491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:48.655034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-75e003f0-5dc2-451d-9c51-4841c0df9933 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:48.656283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-75e003f0-5dc2-451d-9c51-4841c0df9933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:48.750704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:48.790776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb82f82-3227-4500-bce7-6ee0a2fc06c6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:48.792340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ffb82f82-3227-4500-bce7-6ee0a2fc06c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:48.898917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb82f82-3227-4500-bce7-6ee0a2fc06c6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:48.931222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:48.973952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bd991-ebcb-4dc6-a837-2e3abfecdcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:48.974553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bd991-ebcb-4dc6-a837-2e3abfecdcfe service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:48.974829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bd991-ebcb-4dc6-a837-2e3abfecdcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:48.975102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bd991-ebcb-4dc6-a837-2e3abfecdcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:48.976727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bf2bd991-ebcb-4dc6-a837-2e3abfecdcfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:49.083672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bd991-ebcb-4dc6-a837-2e3abfecdcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:49.085108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bd991-ebcb-4dc6-a837-2e3abfecdcfe service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:49.103341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 733/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:51.294014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348260d4-8ce5-4630-9d74-852bb84b50ca None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:51.294597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348260d4-8ce5-4630-9d74-852bb84b50ca None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:51.294597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348260d4-8ce5-4630-9d74-852bb84b50ca None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:51.296322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:51.301819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cf974-7c16-40b9-a347-a604c3287e66 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:51.302316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cf974-7c16-40b9-a347-a604c3287e66 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:51.302688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cf974-7c16-40b9-a347-a604c3287e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:51.367239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c02cf974-7c16-40b9-a347-a604c3287e66 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:51.368472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c02cf974-7c16-40b9-a347-a604c3287e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:51.381375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:51.463785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:51.502899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348260d4-8ce5-4630-9d74-852bb84b50ca None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:51.504485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-348260d4-8ce5-4630-9d74-852bb84b50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:51.610733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348260d4-8ce5-4630-9d74-852bb84b50ca None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:51.623378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:51.686396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07e02d-42b0-4b36-838a-8af293f8a9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:51.686991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07e02d-42b0-4b36-838a-8af293f8a9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:51.687266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07e02d-42b0-4b36-838a-8af293f8a9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:51.687568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07e02d-42b0-4b36-838a-8af293f8a9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:51.689150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3d07e02d-42b0-4b36-838a-8af293f8a9f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:51.795120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07e02d-42b0-4b36-838a-8af293f8a9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:51.796691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07e02d-42b0-4b36-838a-8af293f8a9f1 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:51.814446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 712/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:54.228536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529414e-6df4-4efa-986a-1614c1ced172 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:54.229148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529414e-6df4-4efa-986a-1614c1ced172 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:54.229148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529414e-6df4-4efa-986a-1614c1ced172 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:54.230500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:54.236321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b12d8-49af-43db-b07f-6f6f500006f2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:54.236763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b12d8-49af-43db-b07f-6f6f500006f2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:54.236877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b12d8-49af-43db-b07f-6f6f500006f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:54.284824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:54.304567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6d2b12d8-49af-43db-b07f-6f6f500006f2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:54.305636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6d2b12d8-49af-43db-b07f-6f6f500006f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:54.400991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:54.440869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529414e-6df4-4efa-986a-1614c1ced172 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:54.442382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3529414e-6df4-4efa-986a-1614c1ced172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:54.543152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529414e-6df4-4efa-986a-1614c1ced172 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:54.585575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:54.621128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b6cad-837f-4dcc-a44c-2a48e39df755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:54.621726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b6cad-837f-4dcc-a44c-2a48e39df755 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:54.621996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b6cad-837f-4dcc-a44c-2a48e39df755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:54.622259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b6cad-837f-4dcc-a44c-2a48e39df755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:54.623912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4a9b6cad-837f-4dcc-a44c-2a48e39df755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:54.735564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b6cad-837f-4dcc-a44c-2a48e39df755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:54.737004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b6cad-837f-4dcc-a44c-2a48e39df755 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:54.755316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 736/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:56.898050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd180f-f630-4b9b-bb08-56e1d9585b29 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:56.898611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd180f-f630-4b9b-bb08-56e1d9585b29 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:56.898611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd180f-f630-4b9b-bb08-56e1d9585b29 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:56.899946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:56.905217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78fe5d-9a5d-42dd-8adf-88ba6ddb250f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:56.905670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78fe5d-9a5d-42dd-8adf-88ba6ddb250f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:56.905771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78fe5d-9a5d-42dd-8adf-88ba6ddb250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:56.972436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-eb78fe5d-9a5d-42dd-8adf-88ba6ddb250f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:56.973679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eb78fe5d-9a5d-42dd-8adf-88ba6ddb250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:56.994073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:57.069831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:57.108929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd180f-f630-4b9b-bb08-56e1d9585b29 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:57.110491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-27bd180f-f630-4b9b-bb08-56e1d9585b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:57.215816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd180f-f630-4b9b-bb08-56e1d9585b29 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:57.235877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:57.291457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b91d38-7c38-43be-89a0-ab6d745f79d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:57.292071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91d38-7c38-43be-89a0-ab6d745f79d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:57.292354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91d38-7c38-43be-89a0-ab6d745f79d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:57.292623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91d38-7c38-43be-89a0-ab6d745f79d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:57.294261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-92b91d38-7c38-43be-89a0-ab6d745f79d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:57.403254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91d38-7c38-43be-89a0-ab6d745f79d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:04:57.404723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91d38-7c38-43be-89a0-ab6d745f79d9 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:04:57.422280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 715/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:04:59.517054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3292187-c43d-401b-8b36-be82d736819c None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:59.517632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3292187-c43d-401b-8b36-be82d736819c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:59.517632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3292187-c43d-401b-8b36-be82d736819c None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:59.518937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:04:59.524071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12af6a-ffb4-44b7-87ae-b8258f4e3a29 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:59.524518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12af6a-ffb4-44b7-87ae-b8258f4e3a29 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:59.524631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12af6a-ffb4-44b7-87ae-b8258f4e3a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:59.588527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:59.591360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8d12af6a-ffb4-44b7-87ae-b8258f4e3a29 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:04:59.593186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8d12af6a-ffb4-44b7-87ae-b8258f4e3a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:59.688607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:04:59.726233 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3292187-c43d-401b-8b36-be82d736819c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:04:59.727822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c3292187-c43d-401b-8b36-be82d736819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:04:59.830669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3292187-c43d-401b-8b36-be82d736819c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:04:59.879852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:04:59.903516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb9fa-dca2-402b-900a-f2f41a013691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:04:59.904115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb9fa-dca2-402b-900a-f2f41a013691 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:04:59.904407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb9fa-dca2-402b-900a-f2f41a013691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:04:59.904671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb9fa-dca2-402b-900a-f2f41a013691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:04:59.906340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0a0cb9fa-dca2-402b-900a-f2f41a013691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:00.014533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb9fa-dca2-402b-900a-f2f41a013691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:00.016012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb9fa-dca2-402b-900a-f2f41a013691 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:00.035626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 739/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:02.119368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dda25a-fbb8-4a34-9c7d-f904842ec647 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:02.119937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dda25a-fbb8-4a34-9c7d-f904842ec647 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:02.120060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dda25a-fbb8-4a34-9c7d-f904842ec647 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:02.121390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:02.126665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45649fb8-108b-4f44-b310-c3680669fb26 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:02.127136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45649fb8-108b-4f44-b310-c3680669fb26 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:02.127247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45649fb8-108b-4f44-b310-c3680669fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:02.191435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-45649fb8-108b-4f44-b310-c3680669fb26 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:02.192660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-45649fb8-108b-4f44-b310-c3680669fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:02.221577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:02.287712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:02.327035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dda25a-fbb8-4a34-9c7d-f904842ec647 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:02.328732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-85dda25a-fbb8-4a34-9c7d-f904842ec647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:02.432462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dda25a-fbb8-4a34-9c7d-f904842ec647 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:02.460865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:02.507618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b0df3-9cbc-4261-8703-7f7953e342a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:02.508219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b0df3-9cbc-4261-8703-7f7953e342a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:02.508496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b0df3-9cbc-4261-8703-7f7953e342a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:02.508765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b0df3-9cbc-4261-8703-7f7953e342a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:02.510419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-537b0df3-9cbc-4261-8703-7f7953e342a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:02.743546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b0df3-9cbc-4261-8703-7f7953e342a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:02.744968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b0df3-9cbc-4261-8703-7f7953e342a8 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:02.762902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 718/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:04.893334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224715-d50b-45b4-a47b-b410856f23b0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:04.893870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224715-d50b-45b4-a47b-b410856f23b0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:04.893870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224715-d50b-45b4-a47b-b410856f23b0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:04.895152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:04.900453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6afb0-5b71-40b7-a37f-56e50fe08b42 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:04.900918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6afb0-5b71-40b7-a37f-56e50fe08b42 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:04.901031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6afb0-5b71-40b7-a37f-56e50fe08b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:04.966477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9db6afb0-5b71-40b7-a37f-56e50fe08b42 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:04.968249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9db6afb0-5b71-40b7-a37f-56e50fe08b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:04.976428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:05.066445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:05.104549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c224715-d50b-45b4-a47b-b410856f23b0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:05.106082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6c224715-d50b-45b4-a47b-b410856f23b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:05.209830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c224715-d50b-45b4-a47b-b410856f23b0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:05.267797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:05.285818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e36d79-2b57-4560-99e1-9f93a686eb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:05.286434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36d79-2b57-4560-99e1-9f93a686eb62 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:05.286713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36d79-2b57-4560-99e1-9f93a686eb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:05.286984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36d79-2b57-4560-99e1-9f93a686eb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:05.288642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-97e36d79-2b57-4560-99e1-9f93a686eb62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:05.398186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e36d79-2b57-4560-99e1-9f93a686eb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:05.399633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e36d79-2b57-4560-99e1-9f93a686eb62 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:05.417979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 742/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:07.481323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedab299-e19c-41ec-931d-030ce012ad7d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:07.481858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedab299-e19c-41ec-931d-030ce012ad7d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:07.481858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedab299-e19c-41ec-931d-030ce012ad7d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:07.483650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:07.490018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181200-db37-4638-b42f-c5e58316826a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:07.490618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181200-db37-4638-b42f-c5e58316826a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:07.490901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181200-db37-4638-b42f-c5e58316826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:07.559555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3c181200-db37-4638-b42f-c5e58316826a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:07.560683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3c181200-db37-4638-b42f-c5e58316826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:07.598442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:07.656017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:07.694622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedab299-e19c-41ec-931d-030ce012ad7d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:07.696200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fedab299-e19c-41ec-931d-030ce012ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:07.799300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedab299-e19c-41ec-931d-030ce012ad7d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:07.838365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:07.874007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f7f6-060c-416f-84da-80422bb7367c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:07.874592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f7f6-060c-416f-84da-80422bb7367c service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:07.874860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f7f6-060c-416f-84da-80422bb7367c service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:07.875119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f7f6-060c-416f-84da-80422bb7367c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:07.876718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c0b7f7f6-060c-416f-84da-80422bb7367c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:07.986359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f7f6-060c-416f-84da-80422bb7367c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:07.987819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f7f6-060c-416f-84da-80422bb7367c service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:08.007808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 721/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:10.021403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38038c5c-af9c-4848-a309-32357745c503 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:10.022004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38038c5c-af9c-4848-a309-32357745c503 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:10.022004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38038c5c-af9c-4848-a309-32357745c503 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:10.023289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:10.028623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748683-92a1-47a9-bd8d-769f9283ca5e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:10.029056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748683-92a1-47a9-bd8d-769f9283ca5e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:10.029155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748683-92a1-47a9-bd8d-769f9283ca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:10.098768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e3748683-92a1-47a9-bd8d-769f9283ca5e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:10.099982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e3748683-92a1-47a9-bd8d-769f9283ca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:10.118100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:10.194492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:10.232170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38038c5c-af9c-4848-a309-32357745c503 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:10.234859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-38038c5c-af9c-4848-a309-32357745c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:10.341346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38038c5c-af9c-4848-a309-32357745c503 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:10.409992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:10.417225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a1ac3-52a6-42f0-8cfe-52b270dd8b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:10.417824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a1ac3-52a6-42f0-8cfe-52b270dd8b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:10.418099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a1ac3-52a6-42f0-8cfe-52b270dd8b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:10.418375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a1ac3-52a6-42f0-8cfe-52b270dd8b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:10.419985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0b5a1ac3-52a6-42f0-8cfe-52b270dd8b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:10.529253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a1ac3-52a6-42f0-8cfe-52b270dd8b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:10.531399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a1ac3-52a6-42f0-8cfe-52b270dd8b7e service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:10.549705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 745/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:12.586299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f61a9-f64a-4836-ae99-ea6ed8bf1640 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:12.586831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f61a9-f64a-4836-ae99-ea6ed8bf1640 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:12.586831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f61a9-f64a-4836-ae99-ea6ed8bf1640 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:12.588209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:12.594302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee786ee-5cbb-4091-b157-1e4d6542ddb5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:12.594302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee786ee-5cbb-4091-b157-1e4d6542ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:12.594882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee786ee-5cbb-4091-b157-1e4d6542ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:12.666086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bee786ee-5cbb-4091-b157-1e4d6542ddb5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:12.667297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bee786ee-5cbb-4091-b157-1e4d6542ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:12.721028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:12.771180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:12.809612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f61a9-f64a-4836-ae99-ea6ed8bf1640 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:12.811657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-297f61a9-f64a-4836-ae99-ea6ed8bf1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:12.914319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f61a9-f64a-4836-ae99-ea6ed8bf1640 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:12.961320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:12.988026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fff1c1-7963-4a16-b475-b06d2c9e3f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:12.988626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fff1c1-7963-4a16-b475-b06d2c9e3f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:12.988900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fff1c1-7963-4a16-b475-b06d2c9e3f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:12.989173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fff1c1-7963-4a16-b475-b06d2c9e3f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:12.990768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-46fff1c1-7963-4a16-b475-b06d2c9e3f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:13.100161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fff1c1-7963-4a16-b475-b06d2c9e3f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:13.101634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fff1c1-7963-4a16-b475-b06d2c9e3f19 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:13.119831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 724/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:22.769358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=22 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:23.117453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=66 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:33.243422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b3a02-0be2-49b3-a710-12e5a2a3708e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:33.244029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b3a02-0be2-49b3-a710-12e5a2a3708e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:33.244029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b3a02-0be2-49b3-a710-12e5a2a3708e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:33.245363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 747/1471] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:05:33.251293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035fa4a-78f5-40ff-a4b1-b7fe0a462e2b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:33.251839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035fa4a-78f5-40ff-a4b1-b7fe0a462e2b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:33.251946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035fa4a-78f5-40ff-a4b1-b7fe0a462e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:33.321776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b035fa4a-78f5-40ff-a4b1-b7fe0a462e2b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:33.322976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b035fa4a-78f5-40ff-a4b1-b7fe0a462e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:33.432109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 725/1472] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:33.528172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511635-9d89-425e-b767-d038580df114 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:33.528454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511635-9d89-425e-b767-d038580df114 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:33.528723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511635-9d89-425e-b767-d038580df114 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:33.530057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 748/1473] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 10 08:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:05:33.535456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e242-b56a-4440-be78-6a82c29c75ad None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:33.535750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e242-b56a-4440-be78-6a82c29c75ad None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:33.536014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e242-b56a-4440-be78-6a82c29c75ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:33.613803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ff67e242-b56a-4440-be78-6a82c29c75ad None None] MFA Rules not processed for user `de7826aa1f8e4076ad5656f8cf7fe2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:33.615006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ff67e242-b56a-4440-be78-6a82c29c75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:33.637128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:33.696786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 726/1474] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 10 08:05:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:05:33.704923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36511635-9d89-425e-b767-d038580df114 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:33.706430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-36511635-9d89-425e-b767-d038580df114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:33.809288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36511635-9d89-425e-b767-d038580df114 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:33.881738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f037bbd-3656-44a8-a287-663436fcc546 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:33.882334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037bbd-3656-44a8-a287-663436fcc546 service glance] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:33.882611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037bbd-3656-44a8-a287-663436fcc546 service glance] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:33.882877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037bbd-3656-44a8-a287-663436fcc546 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:33.884502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8f037bbd-3656-44a8-a287-663436fcc546 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:33.942879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:33.996976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f037bbd-3656-44a8-a287-663436fcc546 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:33.998415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f037bbd-3656-44a8-a287-663436fcc546 service glance] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:34.017950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 749/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:36.161972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ba626-fa2f-4692-817b-33066835d951 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:36.162567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ba626-fa2f-4692-817b-33066835d951 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:36.162567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ba626-fa2f-4692-817b-33066835d951 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:36.163896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 727/1476] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:36.169100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de179-6296-4e61-bab1-5397593d08f7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:36.169555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de179-6296-4e61-bab1-5397593d08f7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:36.169662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de179-6296-4e61-bab1-5397593d08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:36.234956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e93de179-6296-4e61-bab1-5397593d08f7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:36.236176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e93de179-6296-4e61-bab1-5397593d08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:36.333376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 750/1477] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:36.356897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ba626-fa2f-4692-817b-33066835d951 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:36.359023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e44ba626-fa2f-4692-817b-33066835d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:36.485984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ba626-fa2f-4692-817b-33066835d951 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:36.535404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:36.584178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84764461-240a-4112-a630-5fc37ac7a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:36.584906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84764461-240a-4112-a630-5fc37ac7a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:36.585271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84764461-240a-4112-a630-5fc37ac7a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:36.585544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84764461-240a-4112-a630-5fc37ac7a3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:36.586302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84764461-240a-4112-a630-5fc37ac7a3d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:36.588265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-84764461-240a-4112-a630-5fc37ac7a3d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:05:36.588265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:05:36.588265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:05:36.589585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84764461-240a-4112-a630-5fc37ac7a3d1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:36.612259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 728/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 08:05:36 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:05:38.649195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6c996-47ac-4172-b0ae-26bb1fb956d6 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:38.649782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6c996-47ac-4172-b0ae-26bb1fb956d6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:38.649782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6c996-47ac-4172-b0ae-26bb1fb956d6 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:38.651086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 751/1479] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:38.657321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef62d3-49fd-4b40-8fd1-2f70ba4d2511 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:38.657751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef62d3-49fd-4b40-8fd1-2f70ba4d2511 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:38.657856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef62d3-49fd-4b40-8fd1-2f70ba4d2511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:38.723345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-04ef62d3-49fd-4b40-8fd1-2f70ba4d2511 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:38.724586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-04ef62d3-49fd-4b40-8fd1-2f70ba4d2511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:38.818824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 729/1480] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:38.865494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6c996-47ac-4172-b0ae-26bb1fb956d6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:38.867306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f4a6c996-47ac-4172-b0ae-26bb1fb956d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:38.877303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:39.012046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6c996-47ac-4172-b0ae-26bb1fb956d6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:39.094572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:39.128292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c80dde-8bd7-4308-b4e4-29f16cc00a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:39.128822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c80dde-8bd7-4308-b4e4-29f16cc00a44 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:39.129102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c80dde-8bd7-4308-b4e4-29f16cc00a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:39.129374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c80dde-8bd7-4308-b4e4-29f16cc00a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:39.131014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-72c80dde-8bd7-4308-b4e4-29f16cc00a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:39.226675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c80dde-8bd7-4308-b4e4-29f16cc00a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:39.228566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c80dde-8bd7-4308-b4e4-29f16cc00a44 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:39.251174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 752/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:41.470782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae941-cef8-4fd2-bf91-d854314b31c6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.471325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae941-cef8-4fd2-bf91-d854314b31c6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.471325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae941-cef8-4fd2-bf91-d854314b31c6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.472712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 730/1482] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:41.478056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35a16-6a61-4a35-9c38-56922019eceb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.478453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35a16-6a61-4a35-9c38-56922019eceb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.478727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35a16-6a61-4a35-9c38-56922019eceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.550853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6fe35a16-6a61-4a35-9c38-56922019eceb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:41.552092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6fe35a16-6a61-4a35-9c38-56922019eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:41.600580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:41.654078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 753/1483] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:41.692234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae941-cef8-4fd2-bf91-d854314b31c6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:41.693778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-37cae941-cef8-4fd2-bf91-d854314b31c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:41.718551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:41.806820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae941-cef8-4fd2-bf91-d854314b31c6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:41.878617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19fa07-79c4-453d-ac79-b343a2a7cba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:41.879129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fa07-79c4-453d-ac79-b343a2a7cba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:41.879399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fa07-79c4-453d-ac79-b343a2a7cba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:41.879697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fa07-79c4-453d-ac79-b343a2a7cba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:41.881300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5d19fa07-79c4-453d-ac79-b343a2a7cba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:41.953875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:41.991125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19fa07-79c4-453d-ac79-b343a2a7cba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:41.992872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19fa07-79c4-453d-ac79-b343a2a7cba4 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:42.013244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 731/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:44.118912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f615967-285a-41a4-9d17-7888c2f9a560 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:44.119574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f615967-285a-41a4-9d17-7888c2f9a560 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:44.119574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f615967-285a-41a4-9d17-7888c2f9a560 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:44.120819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 754/1485] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:44.127069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ebc98-184b-48f5-8b5d-004b907b2e57 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:44.127592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ebc98-184b-48f5-8b5d-004b907b2e57 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:44.127840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ebc98-184b-48f5-8b5d-004b907b2e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:44.198937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-477ebc98-184b-48f5-8b5d-004b907b2e57 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:44.200388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-477ebc98-184b-48f5-8b5d-004b907b2e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:44.297957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 732/1486] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:44.341086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f615967-285a-41a4-9d17-7888c2f9a560 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:44.342631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1f615967-285a-41a4-9d17-7888c2f9a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:44.449779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f615967-285a-41a4-9d17-7888c2f9a560 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:44.523817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:44.526625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f39a5-1643-49a7-8ec0-85b634daf591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:44.527533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f39a5-1643-49a7-8ec0-85b634daf591 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:44.528028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f39a5-1643-49a7-8ec0-85b634daf591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:44.528313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f39a5-1643-49a7-8ec0-85b634daf591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:44.530952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4d2f39a5-1643-49a7-8ec0-85b634daf591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:44.648678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f39a5-1643-49a7-8ec0-85b634daf591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:44.650118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f39a5-1643-49a7-8ec0-85b634daf591 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:44.668408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 755/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:46.852468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef8fb-d58b-441e-af2a-d79cafacb68e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:46.852998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef8fb-d58b-441e-af2a-d79cafacb68e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:46.852998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef8fb-d58b-441e-af2a-d79cafacb68e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:46.854305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 733/1488] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:46.859665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7619-2d4d-40c9-9edf-408db851bc28 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:46.860184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7619-2d4d-40c9-9edf-408db851bc28 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:46.860184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7619-2d4d-40c9-9edf-408db851bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:46.925701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-851c7619-2d4d-40c9-9edf-408db851bc28 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:46.926908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-851c7619-2d4d-40c9-9edf-408db851bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:46.979286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:47.026385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 756/1489] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:05:47.068369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ef8fb-d58b-441e-af2a-d79cafacb68e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:47.070073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e37ef8fb-d58b-441e-af2a-d79cafacb68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:47.106648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:47.181545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ef8fb-d58b-441e-af2a-d79cafacb68e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:47.258992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a58d2-f5e4-4c3e-b325-f0584399c751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:47.259614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a58d2-f5e4-4c3e-b325-f0584399c751 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:47.259892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a58d2-f5e4-4c3e-b325-f0584399c751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:47.260160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a58d2-f5e4-4c3e-b325-f0584399c751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:47.261829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5b1a58d2-f5e4-4c3e-b325-f0584399c751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:47.344147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:47.375395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a58d2-f5e4-4c3e-b325-f0584399c751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:47.376800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a58d2-f5e4-4c3e-b325-f0584399c751 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:47.394580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 734/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:49.721189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa69d-83d2-41cc-a40c-5db2d01b414b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.721725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa69d-83d2-41cc-a40c-5db2d01b414b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.721725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa69d-83d2-41cc-a40c-5db2d01b414b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.723000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 757/1491] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 08:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:05:49.728198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb47af-ab10-4136-a3b8-00bef9bfc15b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:49.728721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb47af-ab10-4136-a3b8-00bef9bfc15b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:49.728833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb47af-ab10-4136-a3b8-00bef9bfc15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:49.793772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-63eb47af-ab10-4136-a3b8-00bef9bfc15b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:05:49.794987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-63eb47af-ab10-4136-a3b8-00bef9bfc15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:49.893958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 735/1492] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 08:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:05:49.935720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa69d-83d2-41cc-a40c-5db2d01b414b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:05:49.937306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-316aa69d-83d2-41cc-a40c-5db2d01b414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:50.047999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa69d-83d2-41cc-a40c-5db2d01b414b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:05:50.121963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4438e3e-b81a-4477-893a-4eec8270ae47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:05:50.122570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438e3e-b81a-4477-893a-4eec8270ae47 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:05:50.122848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438e3e-b81a-4477-893a-4eec8270ae47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:05:50.123120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438e3e-b81a-4477-893a-4eec8270ae47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:05:50.124875 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e4438e3e-b81a-4477-893a-4eec8270ae47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:05:50.134927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:05:50.238683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4438e3e-b81a-4477-893a-4eec8270ae47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:05:50.240152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4438e3e-b81a-4477-893a-4eec8270ae47 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:05:50.258842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 758/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:05:59.892149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=82 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:06:00.256662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=50 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:03.555480 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:03.556087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:03.556087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:03.676305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:03.677810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:03.784952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 736/1494] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:03.793024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6679a4-a0c1-4e36-aa7f-b6d52e7efa59 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:03.793539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6679a4-a0c1-4e36-aa7f-b6d52e7efa59 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:03.793656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6679a4-a0c1-4e36-aa7f-b6d52e7efa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:03.868987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fd6679a4-a0c1-4e36-aa7f-b6d52e7efa59 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:03.870127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fd6679a4-a0c1-4e36-aa7f-b6d52e7efa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:03.970989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 759/1495] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:03.976371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:03.977564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:03.989442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d64d-5d97-4863-b2e4-566da977436a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:04.050628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:04.084497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:04.085092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:04.085361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:04.085622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:04.086250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:07:04.086542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:04.087593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:04.087593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:07:04.087593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:07:04.088461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:04.100118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 737/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:07:04.108440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6679a4-a0c1-4e36-aa7f-b6d52e7efa59 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:04.118524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6679a4-a0c1-4e36-aa7f-b6d52e7efa59 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:04.182067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:04.217620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:04.218223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:04.219047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:04.219594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:04.220255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:04.221974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:04.221974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: warnings.warn(msg) Aug 10 08:07:04.221974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: Aug 10 08:07:04.223176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:04.279602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 760/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:07:04 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:07:04.284613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:04.286168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:04.320870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a8df-c9ba-43d1-83f8-9ddc6e9902a1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:04.430814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:04.431424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:04.431710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:04.431975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:04.432648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:04.433869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:04.433869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:07:04.433869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:07:04.435059 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:04.482499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 738/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:07:04 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:07:04.487144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:04.488713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:04.551904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99dd2-9c70-45ae-8cf8-2a5c8541fa91 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:04.634800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:04.647872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:04.648484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:04.648754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:04.649020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:04.649659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:04.650825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:04.650825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: warnings.warn(msg) Aug 10 08:07:04.650825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: Aug 10 08:07:04.651860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:04.665468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 761/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:07:04.669501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:04.671002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:04.683111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83819657-96fc-426a-9fe1-0b4d5029f29e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:04.709629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:04.780274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cca67-1d66-410e-999c-e6aa05a6c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:04.780884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cca67-1d66-410e-999c-e6aa05a6c932 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:04.781164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cca67-1d66-410e-999c-e6aa05a6c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:04.781426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cca67-1d66-410e-999c-e6aa05a6c932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:04.782062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cca67-1d66-410e-999c-e6aa05a6c932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:04.783067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-468cca67-1d66-410e-999c-e6aa05a6c932 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:04.783067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:07:04.783067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:07:04.783996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cca67-1d66-410e-999c-e6aa05a6c932 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:04.795984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 739/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:07:04.800968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:04.802516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:04.836905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44cb46-640d-428a-969d-395725da1043 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:04.928502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d4179-b286-43b3-a37b-7a0e49142621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:04.929159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d4179-b286-43b3-a37b-7a0e49142621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:04.929430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d4179-b286-43b3-a37b-7a0e49142621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:04.929694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d4179-b286-43b3-a37b-7a0e49142621 admin admin] PATH_INFO: `/v3/projects/4f7a76d65b8a4111a9d7e6bf7bb042cd/users/7ff33a6510584fcba74c7e299f0da6ec/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:04.951797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d4179-b286-43b3-a37b-7a0e49142621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7a76d65b8a4111a9d7e6bf7bb042cd, user_id=7ff33a6510584fcba74c7e299f0da6ec, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:04.953466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-e26d4179-b286-43b3-a37b-7a0e49142621 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:04.953466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: warnings.warn(msg) Aug 10 08:07:04.953466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: Aug 10 08:07:04.955405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d4179-b286-43b3-a37b-7a0e49142621 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:04.979401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 762/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:07:04 2022] PUT /identity/v3/projects/4f7a76d65b8a4111a9d7e6bf7bb042cd/users/7ff33a6510584fcba74c7e299f0da6ec/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:07:04.992205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd711e2-02fe-4a7b-b522-fde45dccadac None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:04.992488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd711e2-02fe-4a7b-b522-fde45dccadac None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:04.992755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd711e2-02fe-4a7b-b522-fde45dccadac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:05.048681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-dbd711e2-02fe-4a7b-b522-fde45dccadac None None] MFA Rules not processed for user `7ff33a6510584fcba74c7e299f0da6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:05.049900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dbd711e2-02fe-4a7b-b522-fde45dccadac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:05.127714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 740/1502] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:07:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:05.141427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799b9b8-d615-4d5c-ab0e-383fc79abda8 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:05.141715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799b9b8-d615-4d5c-ab0e-383fc79abda8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:05.142016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799b9b8-d615-4d5c-ab0e-383fc79abda8 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:05.143356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 763/1503] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 10 08:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:07:05.148079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c981a-a6e5-4773-9764-bcba36e00f96 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:05.148373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c981a-a6e5-4773-9764-bcba36e00f96 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:05.148637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c981a-a6e5-4773-9764-bcba36e00f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:05.179843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:05.224786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a66c981a-a6e5-4773-9764-bcba36e00f96 None None] MFA Rules not processed for user `a3812df0dc174249acb139876f4302ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:05.225919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a66c981a-a6e5-4773-9764-bcba36e00f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:05.301048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 741/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 10 08:07:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:05.308981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799b9b8-d615-4d5c-ab0e-383fc79abda8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:05.310498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b799b9b8-d615-4d5c-ab0e-383fc79abda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:05.362424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:05.418305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799b9b8-d615-4d5c-ab0e-383fc79abda8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:05.491709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:05.492240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:05.492520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:05.492792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:05.494386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:05.593883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:05.595336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:05.598824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:05.613834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 764/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:07:05.659270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8b673-ee9b-443f-9fac-10d087625401 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:05.659618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8b673-ee9b-443f-9fac-10d087625401 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:05.659941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8b673-ee9b-443f-9fac-10d087625401 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:05.661204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 742/1506] 10.222.0.40 () {52 vars in 830 bytes} [Wed Aug 10 08:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:07:05.664969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:05.666179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:05.769859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a4ad2-a81f-43f6-906a-8df1c301df22 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:05.867930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:05.868657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:05.868825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:05.869092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] PATH_INFO: `/v3/users/7ff33a6510584fcba74c7e299f0da6ec` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:05.882220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff33a6510584fcba74c7e299f0da6ec)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:05.883252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:05.883252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: warnings.warn(msg) Aug 10 08:07:05.883252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: Aug 10 08:07:05.884498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:05.895472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:05.956762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff33a6510584fcba74c7e299f0da6ec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:05.957294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff33a6510584fcba74c7e299f0da6ec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:05.981162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff33a6510584fcba74c7e299f0da6ec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:05.982358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff33a6510584fcba74c7e299f0da6ec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:05.998269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff33a6510584fcba74c7e299f0da6ec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:06.015442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 765/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:07:05 2022] DELETE /identity/v3/users/7ff33a6510584fcba74c7e299f0da6ec => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:07:06.020247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:06.020732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:06.020732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:06.093306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:07:06.094635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:06.185815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:06.200236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 743/1508] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:07:06.211281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:06.212562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:06.326766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f19d7-f74e-4e56-a044-250a5062efbe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:06.394107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:06.423376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4488d4-d482-4e1a-992c-70620224c647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:06.424018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4488d4-d482-4e1a-992c-70620224c647 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:06.424298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4488d4-d482-4e1a-992c-70620224c647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:06.424598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4488d4-d482-4e1a-992c-70620224c647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:06.426688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0c4488d4-d482-4e1a-992c-70620224c647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:06.554596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4488d4-d482-4e1a-992c-70620224c647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:06.555997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4488d4-d482-4e1a-992c-70620224c647 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:06.576346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 766/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:07:06.905196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:07:06.906457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:07:06.918169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0bb9b-1b38-41c9-b76d-bc32c4f773cb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:07:07.015973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:07:07.016592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:07:07.016862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:07:07.017123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] PATH_INFO: `/v3/projects/4f7a76d65b8a4111a9d7e6bf7bb042cd` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:07:07.026717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7a76d65b8a4111a9d7e6bf7bb042cd)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:07:07.027781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:07:07.027781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:07:07.027781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:07:07.028956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:07:07.086027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7a76d65b8a4111a9d7e6bf7bb042cd', 'request_id': 'req-666f38b2-62f6-4d99-99bc-5f00116c0712'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:07.095969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7a76d65b8a4111a9d7e6bf7bb042cd', 'request_id': 'req-666f38b2-62f6-4d99-99bc-5f00116c0712'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:07.102069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7a76d65b8a4111a9d7e6bf7bb042cd', 'request_id': 'req-666f38b2-62f6-4d99-99bc-5f00116c0712'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:07.134325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] The token cache is being invalidate because project 4f7a76d65b8a4111a9d7e6bf7bb042cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:07:07.134617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:07.135048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-666f38b2-62f6-4d99-99bc-5f00116c0712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:07:07.136500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 744/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:07:06 2022] DELETE /identity/v3/projects/4f7a76d65b8a4111a9d7e6bf7bb042cd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:07:16.574054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=62 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:07:17.132035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:37.104321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4d562-d086-4ca7-a83c-bac4a4cf9a93 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:37.104926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4d562-d086-4ca7-a83c-bac4a4cf9a93 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:37.104926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4d562-d086-4ca7-a83c-bac4a4cf9a93 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:37.106236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:08:37.111666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651d63-e419-4130-873f-783a3896e74d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:37.112142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651d63-e419-4130-873f-783a3896e74d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:37.112253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651d63-e419-4130-873f-783a3896e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:37.196046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d9651d63-e419-4130-873f-783a3896e74d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:37.197266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d9651d63-e419-4130-873f-783a3896e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:37.302009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:37.456446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4d562-d086-4ca7-a83c-bac4a4cf9a93 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:37.458534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-25c4d562-d086-4ca7-a83c-bac4a4cf9a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:37.581079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4d562-d086-4ca7-a83c-bac4a4cf9a93 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:37.586470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f43f0-b8d8-4dad-9324-f8c052ee6d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:37.587096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f43f0-b8d8-4dad-9324-f8c052ee6d9e service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:37.587369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f43f0-b8d8-4dad-9324-f8c052ee6d9e service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:37.587667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f43f0-b8d8-4dad-9324-f8c052ee6d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:37.595456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f43f0-b8d8-4dad-9324-f8c052ee6d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:37.597032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f43f0-b8d8-4dad-9324-f8c052ee6d9e service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:37.606045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 768/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:38.441528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21cde-7bf4-48d3-a86e-5001507ae439 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:38.442116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21cde-7bf4-48d3-a86e-5001507ae439 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:38.442116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21cde-7bf4-48d3-a86e-5001507ae439 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:38.443437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:08:38.448129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddee7b-81d7-47d1-a5e4-49eaab7f1224 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:38.448575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddee7b-81d7-47d1-a5e4-49eaab7f1224 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:38.448681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddee7b-81d7-47d1-a5e4-49eaab7f1224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:38.468458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-77ddee7b-81d7-47d1-a5e4-49eaab7f1224 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:38.469641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-77ddee7b-81d7-47d1-a5e4-49eaab7f1224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:38.477399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:38.628374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd21cde-7bf4-48d3-a86e-5001507ae439 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:38.642832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd21cde-7bf4-48d3-a86e-5001507ae439 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:38.648434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1adbc6-d32c-4673-82cb-2813f01fcb94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:38.649038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1adbc6-d32c-4673-82cb-2813f01fcb94 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:38.649316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1adbc6-d32c-4673-82cb-2813f01fcb94 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:38.649591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1adbc6-d32c-4673-82cb-2813f01fcb94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:38.658967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1adbc6-d32c-4673-82cb-2813f01fcb94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:38.660623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1adbc6-d32c-4673-82cb-2813f01fcb94 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:38.672772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 747/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:38.692306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd0d3c-ecaf-454f-9e63-aac218271a50 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:38.692600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd0d3c-ecaf-454f-9e63-aac218271a50 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:38.692879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd0d3c-ecaf-454f-9e63-aac218271a50 None None] PATH_INFO: `/v3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:38.694252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 770/1517] 10.222.0.13 () {54 vars in 925 bytes} [Wed Aug 10 08:08:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:08:38.700416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95f96-9326-4fa6-9138-493a66000747 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:38.700703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95f96-9326-4fa6-9138-493a66000747 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:38.700980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95f96-9326-4fa6-9138-493a66000747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:38.767237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-09a95f96-9326-4fa6-9138-493a66000747 None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:38.768510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-09a95f96-9326-4fa6-9138-493a66000747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:38.787732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:08:38.845335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 748/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Aug 10 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:08:47.710110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad84ab7-dcae-48a9-b6f9-98d853f8b3f0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:47.710777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad84ab7-dcae-48a9-b6f9-98d853f8b3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:47.710777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad84ab7-dcae-48a9-b6f9-98d853f8b3f0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:47.712004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 771/1519] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 10 08:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:08:47.717142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd8487-4705-4e5b-bd87-86e236e33e0e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:47.717618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd8487-4705-4e5b-bd87-86e236e33e0e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:47.717738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd8487-4705-4e5b-bd87-86e236e33e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:47.738012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6abd8487-4705-4e5b-bd87-86e236e33e0e None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:47.739201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6abd8487-4705-4e5b-bd87-86e236e33e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:47.747536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 749/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 10 08:08:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:47.755612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad84ab7-dcae-48a9-b6f9-98d853f8b3f0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:47.768727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad84ab7-dcae-48a9-b6f9-98d853f8b3f0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:47.773597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1ed7b-4410-4ac1-8ee9-141c3671278a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:47.774178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1ed7b-4410-4ac1-8ee9-141c3671278a service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:47.774456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1ed7b-4410-4ac1-8ee9-141c3671278a service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:47.774724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1ed7b-4410-4ac1-8ee9-141c3671278a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:47.783241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1ed7b-4410-4ac1-8ee9-141c3671278a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:47.784831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1ed7b-4410-4ac1-8ee9-141c3671278a service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:47.794108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 772/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:49.899036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a183cf-93c0-42a9-b84d-2f2d627b2229 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:49.899644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a183cf-93c0-42a9-b84d-2f2d627b2229 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:49.899644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a183cf-93c0-42a9-b84d-2f2d627b2229 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:49.900929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:08:49.906263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe953d-a7c7-419d-94f4-82b880a121bd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:49.906727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe953d-a7c7-419d-94f4-82b880a121bd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:49.906830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe953d-a7c7-419d-94f4-82b880a121bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:49.926896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-00fe953d-a7c7-419d-94f4-82b880a121bd None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:49.928147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-00fe953d-a7c7-419d-94f4-82b880a121bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:49.935970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:50.092208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a183cf-93c0-42a9-b84d-2f2d627b2229 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:50.107696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a183cf-93c0-42a9-b84d-2f2d627b2229 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:50.113861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab03b6b-5a0e-4bf9-a9c2-011cc1da5e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:50.114452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab03b6b-5a0e-4bf9-a9c2-011cc1da5e71 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:50.114728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab03b6b-5a0e-4bf9-a9c2-011cc1da5e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:50.114996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab03b6b-5a0e-4bf9-a9c2-011cc1da5e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:50.122897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab03b6b-5a0e-4bf9-a9c2-011cc1da5e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:50.125026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab03b6b-5a0e-4bf9-a9c2-011cc1da5e71 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:50.134248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 751/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:50.948561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179949b-01bd-4d64-9623-7523c12cc2bc None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:50.949123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179949b-01bd-4d64-9623-7523c12cc2bc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:50.949123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179949b-01bd-4d64-9623-7523c12cc2bc None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:50.950373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:08:50.955996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8590-41e6-47b5-99a1-13e374da918a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:50.956449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8590-41e6-47b5-99a1-13e374da918a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:50.956564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8590-41e6-47b5-99a1-13e374da918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:50.976079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-086f8590-41e6-47b5-99a1-13e374da918a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:50.977302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-086f8590-41e6-47b5-99a1-13e374da918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:50.985632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:51.137755 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179949b-01bd-4d64-9623-7523c12cc2bc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:51.153025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179949b-01bd-4d64-9623-7523c12cc2bc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:51.158515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef8dbe-7615-49f8-b0ff-8d69258ee09b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:51.159107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef8dbe-7615-49f8-b0ff-8d69258ee09b service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:51.159379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef8dbe-7615-49f8-b0ff-8d69258ee09b service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:51.159683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef8dbe-7615-49f8-b0ff-8d69258ee09b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:51.167481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef8dbe-7615-49f8-b0ff-8d69258ee09b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:51.169051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef8dbe-7615-49f8-b0ff-8d69258ee09b service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:51.178264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 775/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:55.144396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12887e7-335d-41cb-bd76-4d302f8891f2 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:55.144976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12887e7-335d-41cb-bd76-4d302f8891f2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:55.144976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12887e7-335d-41cb-bd76-4d302f8891f2 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:55.146266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:08:55.151285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6077ac-c5bf-49e5-975b-d7107ac5ba77 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:55.151722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6077ac-c5bf-49e5-975b-d7107ac5ba77 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:55.151882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6077ac-c5bf-49e5-975b-d7107ac5ba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:55.171581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9c6077ac-c5bf-49e5-975b-d7107ac5ba77 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:55.172767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9c6077ac-c5bf-49e5-975b-d7107ac5ba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:55.180365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:55.253902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12887e7-335d-41cb-bd76-4d302f8891f2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:55.255669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c12887e7-335d-41cb-bd76-4d302f8891f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:55.335840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12887e7-335d-41cb-bd76-4d302f8891f2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:55.339511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e3ac-dcb7-4392-a9ff-e61a12036995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:55.340117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e3ac-dcb7-4392-a9ff-e61a12036995 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:55.340397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e3ac-dcb7-4392-a9ff-e61a12036995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:55.340671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e3ac-dcb7-4392-a9ff-e61a12036995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:55.350575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e3ac-dcb7-4392-a9ff-e61a12036995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:55.352036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e3ac-dcb7-4392-a9ff-e61a12036995 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:55.361570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 754/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:08:57.351873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7614-ef65-496c-ad7e-60af7f849de1 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:57.352391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7614-ef65-496c-ad7e-60af7f849de1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:57.352503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7614-ef65-496c-ad7e-60af7f849de1 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:57.353826 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:08:57.359032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2623bf1-bcea-42ab-95bc-38cca87af135 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:57.359506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2623bf1-bcea-42ab-95bc-38cca87af135 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:57.359609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2623bf1-bcea-42ab-95bc-38cca87af135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:57.378365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a2623bf1-bcea-42ab-95bc-38cca87af135 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:08:57.379611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2623bf1-bcea-42ab-95bc-38cca87af135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:08:57.387452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:08:57.423956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b7614-ef65-496c-ad7e-60af7f849de1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:08:57.434501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b7614-ef65-496c-ad7e-60af7f849de1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:08:57.438508 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227c6e4-cf0f-49ad-be18-3a270e090115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:08:57.439098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227c6e4-cf0f-49ad-be18-3a270e090115 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:08:57.439376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227c6e4-cf0f-49ad-be18-3a270e090115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:08:57.439679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227c6e4-cf0f-49ad-be18-3a270e090115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:08:57.448372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227c6e4-cf0f-49ad-be18-3a270e090115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:08:57.449783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227c6e4-cf0f-49ad-be18-3a270e090115 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:08:57.459819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 778/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:01.164311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c988b5-8840-4edd-b5ee-a2c60a976c0c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:01.164880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c988b5-8840-4edd-b5ee-a2c60a976c0c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:01.164880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c988b5-8840-4edd-b5ee-a2c60a976c0c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:01.166175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:09:01.171892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e307-ad43-4727-ae59-81056e14e95d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:01.172333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e307-ad43-4727-ae59-81056e14e95d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:01.172448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e307-ad43-4727-ae59-81056e14e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:01.192030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5817e307-ad43-4727-ae59-81056e14e95d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:01.193226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5817e307-ad43-4727-ae59-81056e14e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:01.201008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:01.502093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c988b5-8840-4edd-b5ee-a2c60a976c0c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:01.503900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c0c988b5-8840-4edd-b5ee-a2c60a976c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:01.567376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:01.581257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c988b5-8840-4edd-b5ee-a2c60a976c0c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:01.584806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee09139-7b42-4d54-941b-4e9b450f58c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:01.585392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09139-7b42-4d54-941b-4e9b450f58c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:01.585666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09139-7b42-4d54-941b-4e9b450f58c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:01.585933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09139-7b42-4d54-941b-4e9b450f58c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:01.594617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee09139-7b42-4d54-941b-4e9b450f58c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:01.596076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee09139-7b42-4d54-941b-4e9b450f58c5 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:01.605179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 757/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:03.625693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0dd52-67b4-4593-af9c-ed5143177a5f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:03.626267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0dd52-67b4-4593-af9c-ed5143177a5f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:03.626267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0dd52-67b4-4593-af9c-ed5143177a5f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:03.627760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:09:03.632866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fe336-f3e0-4e2c-b480-902d7d7930f6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:03.633295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fe336-f3e0-4e2c-b480-902d7d7930f6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:03.633401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fe336-f3e0-4e2c-b480-902d7d7930f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:03.653130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e52fe336-f3e0-4e2c-b480-902d7d7930f6 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:09:03.654313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e52fe336-f3e0-4e2c-b480-902d7d7930f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:03.662596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:09:03.963326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0dd52-67b4-4593-af9c-ed5143177a5f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:09:03.965120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d8c0dd52-67b4-4593-af9c-ed5143177a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:09:03.977937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0dd52-67b4-4593-af9c-ed5143177a5f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:09:03.981384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db18e5-bf05-4104-92f6-31f11f2c6d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:09:03.981971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db18e5-bf05-4104-92f6-31f11f2c6d30 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:09:03.982249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db18e5-bf05-4104-92f6-31f11f2c6d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:09:03.982519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db18e5-bf05-4104-92f6-31f11f2c6d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:09:03.991332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db18e5-bf05-4104-92f6-31f11f2c6d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:09:03.992869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db18e5-bf05-4104-92f6-31f11f2c6d30 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:09:04.002880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 781/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:09:13.648408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=11 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:09:13.998023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:26.141708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcbf50-f2c0-42a7-9f67-35b407707c98 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.142393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcbf50-f2c0-42a7-9f67-35b407707c98 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.142393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcbf50-f2c0-42a7-9f67-35b407707c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.172818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-37fcbf50-f2c0-42a7-9f67-35b407707c98 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.174611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-37fcbf50-f2c0-42a7-9f67-35b407707c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.184508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 759/1540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:26.194814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313e7b8-5e52-4020-8c5c-eaba5ac5e2b6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.196062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313e7b8-5e52-4020-8c5c-eaba5ac5e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.196555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313e7b8-5e52-4020-8c5c-eaba5ac5e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.224407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d313e7b8-5e52-4020-8c5c-eaba5ac5e2b6 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.226014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d313e7b8-5e52-4020-8c5c-eaba5ac5e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.235154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 782/1541] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.240590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcbf50-f2c0-42a7-9f67-35b407707c98 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.257370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcbf50-f2c0-42a7-9f67-35b407707c98 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.262903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae60a40-2aa4-4e1b-a79e-303fdc3de006 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.263293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae60a40-2aa4-4e1b-a79e-303fdc3de006 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.264250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae60a40-2aa4-4e1b-a79e-303fdc3de006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.265093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195b85-ffef-4890-b0d5-82d99a1951d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.265988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195b85-ffef-4890-b0d5-82d99a1951d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.266506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195b85-ffef-4890-b0d5-82d99a1951d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.266991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195b85-ffef-4890-b0d5-82d99a1951d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.269121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195b85-ffef-4890-b0d5-82d99a1951d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:26.269689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195b85-ffef-4890-b0d5-82d99a1951d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.271627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195b85-ffef-4890-b0d5-82d99a1951d7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.290056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 760/1542] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:26.291831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b0a9a-42b1-40b6-a98c-5147da27e33d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.292557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b0a9a-42b1-40b6-a98c-5147da27e33d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.295456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b0a9a-42b1-40b6-a98c-5147da27e33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.306915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6ae60a40-2aa4-4e1b-a79e-303fdc3de006 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.306915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6ae60a40-2aa4-4e1b-a79e-303fdc3de006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.327142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 783/1543] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 10 08:10:26.328099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae60a40-2aa4-4e1b-a79e-303fdc3de006 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.342731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae60a40-2aa4-4e1b-a79e-303fdc3de006 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.344161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e43b0a9a-42b1-40b6-a98c-5147da27e33d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.345865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e43b0a9a-42b1-40b6-a98c-5147da27e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.357929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0de37-8bb8-4daf-93f7-acb1a3abbc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.358564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0de37-8bb8-4daf-93f7-acb1a3abbc33 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.358847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0de37-8bb8-4daf-93f7-acb1a3abbc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.359122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0de37-8bb8-4daf-93f7-acb1a3abbc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.359891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0de37-8bb8-4daf-93f7-acb1a3abbc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.361808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0de37-8bb8-4daf-93f7-acb1a3abbc33 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.370057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 761/1544] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.371655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d214bf-c88b-4bcf-9efc-96a7ddb076d4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.372162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d214bf-c88b-4bcf-9efc-96a7ddb076d4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.373249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d214bf-c88b-4bcf-9efc-96a7ddb076d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.422826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f2d214bf-c88b-4bcf-9efc-96a7ddb076d4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.429299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f2d214bf-c88b-4bcf-9efc-96a7ddb076d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.435586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 784/1545] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:26.440087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585a25-57db-4297-91ff-40966499a5e5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.440373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585a25-57db-4297-91ff-40966499a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.441275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585a25-57db-4297-91ff-40966499a5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.449031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 762/1546] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.450382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd157cd6-d5f8-4a1e-80a9-4e889788aaf2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.450692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd157cd6-d5f8-4a1e-80a9-4e889788aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.451578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd157cd6-d5f8-4a1e-80a9-4e889788aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.472775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4c585a25-57db-4297-91ff-40966499a5e5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.473995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4c585a25-57db-4297-91ff-40966499a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.482548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-fd157cd6-d5f8-4a1e-80a9-4e889788aaf2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.484190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fd157cd6-d5f8-4a1e-80a9-4e889788aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.543014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 785/1547] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.543967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c585a25-57db-4297-91ff-40966499a5e5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.550978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 763/1548] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.552412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcdd8d-2049-472a-82d5-e9c9e9790b96 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.552726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcdd8d-2049-472a-82d5-e9c9e9790b96 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.553043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcdd8d-2049-472a-82d5-e9c9e9790b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.555210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c585a25-57db-4297-91ff-40966499a5e5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.560116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa964eab-38bc-41db-89b8-c6539f12709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.561592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa964eab-38bc-41db-89b8-c6539f12709c admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.561863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa964eab-38bc-41db-89b8-c6539f12709c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.562126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa964eab-38bc-41db-89b8-c6539f12709c admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.562990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa964eab-38bc-41db-89b8-c6539f12709c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.564054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-aa964eab-38bc-41db-89b8-c6539f12709c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:10:26.564054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: warnings.warn(msg) Aug 10 08:10:26.564054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: Aug 10 08:10:26.565288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa964eab-38bc-41db-89b8-c6539f12709c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.573877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-08fcdd8d-2049-472a-82d5-e9c9e9790b96 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.575092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-08fcdd8d-2049-472a-82d5-e9c9e9790b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.583969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 764/1549] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.584836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcdd8d-2049-472a-82d5-e9c9e9790b96 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.595709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 786/1550] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/users => generated 285 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:26.596521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcdd8d-2049-472a-82d5-e9c9e9790b96 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.597082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f135a1-1460-4daf-9c27-e49979da9c62 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.597363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f135a1-1460-4daf-9c27-e49979da9c62 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.597746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f135a1-1460-4daf-9c27-e49979da9c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.602575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735766f-ef1d-4fab-b042-8f2f4e2726c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.603177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735766f-ef1d-4fab-b042-8f2f4e2726c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.603548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735766f-ef1d-4fab-b042-8f2f4e2726c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.603825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735766f-ef1d-4fab-b042-8f2f4e2726c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.604471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735766f-ef1d-4fab-b042-8f2f4e2726c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:26.604769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735766f-ef1d-4fab-b042-8f2f4e2726c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.606401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735766f-ef1d-4fab-b042-8f2f4e2726c7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.617587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-20f135a1-1460-4daf-9c27-e49979da9c62 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.618565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 765/1551] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:26.618783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-20f135a1-1460-4daf-9c27-e49979da9c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.619858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6371a9-8d20-46da-8e49-02e27697d004 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.620142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6371a9-8d20-46da-8e49-02e27697d004 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.620433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6371a9-8d20-46da-8e49-02e27697d004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.633589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 787/1552] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.634778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9604da-b6f4-4671-958b-4fd711a4a7a1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.635058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9604da-b6f4-4671-958b-4fd711a4a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.635326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9604da-b6f4-4671-958b-4fd711a4a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.643600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ea6371a9-8d20-46da-8e49-02e27697d004 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.644809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ea6371a9-8d20-46da-8e49-02e27697d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.652804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 766/1553] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.653644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6371a9-8d20-46da-8e49-02e27697d004 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.654102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ef9604da-b6f4-4671-958b-4fd711a4a7a1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.655484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ef9604da-b6f4-4671-958b-4fd711a4a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.663762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6371a9-8d20-46da-8e49-02e27697d004 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.663937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 788/1554] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.665005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69f3ef-d2cd-4aa3-860f-450780302d15 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.665243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69f3ef-d2cd-4aa3-860f-450780302d15 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.665519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69f3ef-d2cd-4aa3-860f-450780302d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.668459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4aa78-c71a-46c3-9723-d66c6d1d29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.669060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4aa78-c71a-46c3-9723-d66c6d1d29e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.669388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4aa78-c71a-46c3-9723-d66c6d1d29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.670295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4aa78-c71a-46c3-9723-d66c6d1d29e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.670938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4aa78-c71a-46c3-9723-d66c6d1d29e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:26.671359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4aa78-c71a-46c3-9723-d66c6d1d29e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.673056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4aa78-c71a-46c3-9723-d66c6d1d29e2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.685149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 767/1555] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:26.685838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-eb69f3ef-d2cd-4aa3-860f-450780302d15 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.687058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eb69f3ef-d2cd-4aa3-860f-450780302d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.688260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335376b-df60-4de8-8725-801ffe42ab02 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.688797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335376b-df60-4de8-8725-801ffe42ab02 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.689545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335376b-df60-4de8-8725-801ffe42ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.695306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 789/1556] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.696107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69f3ef-d2cd-4aa3-860f-450780302d15 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.705471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69f3ef-d2cd-4aa3-860f-450780302d15 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.710033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189df8e6-3154-4652-84b9-de038b4cbf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.710610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df8e6-3154-4652-84b9-de038b4cbf25 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.710882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df8e6-3154-4652-84b9-de038b4cbf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.710995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8335376b-df60-4de8-8725-801ffe42ab02 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.711147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df8e6-3154-4652-84b9-de038b4cbf25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.711803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189df8e6-3154-4652-84b9-de038b4cbf25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.712454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8335376b-df60-4de8-8725-801ffe42ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.713398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189df8e6-3154-4652-84b9-de038b4cbf25 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.720725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 768/1557] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.721473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335376b-df60-4de8-8725-801ffe42ab02 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.726201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 790/1558] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:26.726201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db353-e43a-4b23-bb28-813e3d58e3a3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.726201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db353-e43a-4b23-bb28-813e3d58e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.726201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db353-e43a-4b23-bb28-813e3d58e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.731792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335376b-df60-4de8-8725-801ffe42ab02 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.737179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bae479-6b17-4dcd-9088-9e3c7901b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.737768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae479-6b17-4dcd-9088-9e3c7901b9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.738040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae479-6b17-4dcd-9088-9e3c7901b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.738307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae479-6b17-4dcd-9088-9e3c7901b9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.738926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bae479-6b17-4dcd-9088-9e3c7901b9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.740023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-56bae479-6b17-4dcd-9088-9e3c7901b9e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:10:26.740023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:10:26.740023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:10:26.741184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bae479-6b17-4dcd-9088-9e3c7901b9e7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.746944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-654db353-e43a-4b23-bb28-813e3d58e3a3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.748708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-654db353-e43a-4b23-bb28-813e3d58e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.756554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 791/1559] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.757728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7457431-06fa-4048-b1e1-278bd0a12a4e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.758262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7457431-06fa-4048-b1e1-278bd0a12a4e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.758387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7457431-06fa-4048-b1e1-278bd0a12a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.770574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 769/1560] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:26.772707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8111801-3880-4084-8aa3-92267b56e944 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.773207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8111801-3880-4084-8aa3-92267b56e944 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.773645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8111801-3880-4084-8aa3-92267b56e944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.779483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e7457431-06fa-4048-b1e1-278bd0a12a4e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.780682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e7457431-06fa-4048-b1e1-278bd0a12a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.792508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b8111801-3880-4084-8aa3-92267b56e944 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:26.793670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b8111801-3880-4084-8aa3-92267b56e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:26.839856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 792/1561] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.840830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7457431-06fa-4048-b1e1-278bd0a12a4e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.844099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:26.845435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:26.853017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7457431-06fa-4048-b1e1-278bd0a12a4e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.853999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 770/1562] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:26.855108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8111801-3880-4084-8aa3-92267b56e944 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.859220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.859861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.860144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.860415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.861032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.863027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.865095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8111801-3880-4084-8aa3-92267b56e944 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.869683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.870272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.870551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.870843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.871499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:26.871801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.874115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.887772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 771/1563] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:26.895464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.895672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 793/1564] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:26.895672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.900044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac8f12-d54d-49dd-a266-b85dd0582d2f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.956124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.956956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.957232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.957510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.958193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:26.958749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.960424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.961988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869881f-ed34-40f1-aa14-8e42508e0904 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.967642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.968242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.968524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.968799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.969446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.971056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.984171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 772/1565] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:26.984171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.984479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 794/1566] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:26.984479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:26.990305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e7cca-175b-42cb-b48e-3dc003946940 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.992737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4643aa-ebef-4796-ba2d-74ed04268dba admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:26.994846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.995496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.995769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.996164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.996800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:26.997093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:26.997297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:26.997914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:26.998194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:26.998465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:26.998819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:26.999075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.000985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.010221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 773/1567] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:27.011010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.021480 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e70b1-4804-499f-b11a-2ddd2323b76e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.024091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 795/1568] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:26 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.024911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.030958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.031581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.031997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.032436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.032746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:27.033052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.034695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.037085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12382-6491-45b1-9702-7084465c06c3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.043240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.043859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.044155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.044514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.046308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:27.046655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.047661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:10:27.047661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: warnings.warn(msg) Aug 10 08:10:27.047661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: Aug 10 08:10:27.048624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.049288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 774/1569] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:27.050080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.069163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8c44-0a4a-461e-a2f3-303193f8cbfe admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.079038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 796/1570] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:27.079038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.079319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.079319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.079319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.079319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.079771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.079771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.083211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea419ae-ab81-4b96-aaf1-b946725bf66f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.087720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.088313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.088590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.088863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.089477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.091906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.106609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 775/1571] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.108349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.116289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 797/1572] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.117126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.127277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b544-426f-416e-a2db-3b6bdd6f9e7e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.183770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce0b-8d5a-41c7-8c15-62aa04846cd8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.186214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.187048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.187375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.188013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] PATH_INFO: `/v3/projects/a26c40abe2ed4178aa9b7dafc68f0862/users/9df68913f85d427a8be1772b634a0b60/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.190639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.192209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.192560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.192839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.193479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.195452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.203469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26c40abe2ed4178aa9b7dafc68f0862, user_id=9df68913f85d427a8be1772b634a0b60, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.206101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.220776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 798/1573] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:27 2022] PUT /identity/v3/projects/a26c40abe2ed4178aa9b7dafc68f0862/users/9df68913f85d427a8be1772b634a0b60/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:27.221593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.230364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 776/1574] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.230364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.237340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:27.249769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:27.297340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413369c7-07cb-4eb3-98e3-c460c8ec8f66 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.298555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a18ec-fa57-4f72-805c-ab8753217600 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.302142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.302751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.303047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.303321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.303664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.303998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.304265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.304590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.304795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.305435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.305603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.307306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.319816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 777/1575] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.319816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.327832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8ed75-ab03-4372-a624-237243b46d1e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.332469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.333056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.333330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.333598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.334236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.334724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 799/1576] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.335442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.336169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.364567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 778/1577] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.365368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.401065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed0a22-bd26-4550-a10e-02e1d9696b60 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.427369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bee76-b202-4fa0-9087-c2583eb6c074 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.432067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.432662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.432935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.433203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.433814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.436558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.456763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3549a-ee67-41ca-8777-d354fc2d50a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.457393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3549a-ee67-41ca-8777-d354fc2d50a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.457647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3549a-ee67-41ca-8777-d354fc2d50a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.457916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3549a-ee67-41ca-8777-d354fc2d50a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.458524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3549a-ee67-41ca-8777-d354fc2d50a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.459492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 779/1578] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.460222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.463431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3549a-ee67-41ca-8777-d354fc2d50a3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.470144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c74a-d100-4f29-9f18-84a42342069f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.474667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.475184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.475479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.475757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.476384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.477961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.489729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 780/1579] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.490498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.498363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 800/1580] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.498363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3220-d7c8-4bd1-9959-d568bf2bed48 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.498363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3220-d7c8-4bd1-9959-d568bf2bed48 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.498363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3220-d7c8-4bd1-9959-d568bf2bed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.503955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29ff4c-e915-4444-89a0-746db8195450 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.524761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-faec3220-d7c8-4bd1-9959-d568bf2bed48 None None] MFA Rules not processed for user `9df68913f85d427a8be1772b634a0b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:27.525965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-faec3220-d7c8-4bd1-9959-d568bf2bed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:27.543386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:27.562507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.563368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.563677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.563946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.564601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.566486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.583615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:27.589927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 781/1581] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.591223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.596904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 801/1582] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:27.597951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3220-d7c8-4bd1-9959-d568bf2bed48 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.601238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4f8a-05c1-4517-b0d7-17cc2adaee48 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.606806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.608465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.608765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.609042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.609704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.611024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3220-d7c8-4bd1-9959-d568bf2bed48 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.611294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.617096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.617739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.618014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.618331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.619031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.621147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.624198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 782/1583] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.628993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.644657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417529a-039a-4445-83e2-22d1438e172e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.650407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.651037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.651454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.651739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.652383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.654368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 802/1584] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/users => generated 284 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.655496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.655936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.667693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507a7b6-5930-457d-845d-8a8ebaa6abf7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.677258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.677889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.678165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.678439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.679088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.680818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.682964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 783/1585] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.683934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.692346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 803/1586] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.693018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.693863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c305f-19b6-4edd-9bd4-9a8a125fb258 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.698489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.699120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.699395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.699694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.700319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.701940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.702882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf4216-cd50-4023-9f38-c018e32dd4d2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.708601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94454bd7-f8e8-4b3b-a3eb-26c71d679014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.709220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454bd7-f8e8-4b3b-a3eb-26c71d679014 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.709496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454bd7-f8e8-4b3b-a3eb-26c71d679014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.709767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454bd7-f8e8-4b3b-a3eb-26c71d679014 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.710377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94454bd7-f8e8-4b3b-a3eb-26c71d679014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.711988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 784/1587] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.712292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94454bd7-f8e8-4b3b-a3eb-26c71d679014 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.712769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.723217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a877ee-65cc-4eea-b1e1-fa8effe61608 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.729228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.729765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.730046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.730323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.731229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.733473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.737323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 804/1588] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:27.738581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ef05-3098-4ca7-be51-3adc623456be None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.738860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ef05-3098-4ca7-be51-3adc623456be None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.739129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ef05-3098-4ca7-be51-3adc623456be None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.740353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 805/1589] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 08:10:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:10:27.741021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ef05-3098-4ca7-be51-3adc623456be None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.745127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 785/1590] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.746146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.755683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397417-9173-44c8-a0a3-9c90ce491798 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.756722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ef05-3098-4ca7-be51-3adc623456be None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.760772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.761316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.761471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.761629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.761905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.762022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.762335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.762562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.762683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] PATH_INFO: `/v3/projects/3ecbac5606e6423195fa38088b0a88c6/users/671a6dbc4ff14f9086f34208acb36e80/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.764346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.774491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 786/1591] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.778227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.778628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecbac5606e6423195fa38088b0a88c6, user_id=671a6dbc4ff14f9086f34208acb36e80, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.782603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.789259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deff09-135d-4594-add0-5fcda901b6de admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.794246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.794832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.795230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.795541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.796927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.797390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 806/1592] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:27 2022] PUT /identity/v3/projects/3ecbac5606e6423195fa38088b0a88c6/users/671a6dbc4ff14f9086f34208acb36e80/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:27.798479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.807536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.821864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 787/1593] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.821864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.832001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe22da-e2f5-464c-b722-7140f3285e07 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.859756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a837a-caec-4bdc-a00f-e4d7895a486b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.864398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.865003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.865279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.865550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.866177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.868492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.878548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 807/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.879783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.889860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.890517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.890757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68579e3-a396-4430-8ac8-2562ef250e08 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.890924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.891198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] PATH_INFO: `/v3/projects/e42dd73dfb5e45579ebb4bfe689dacea/users/b531d7ca59814d359b30264d2c9f7116/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.895631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fcb5e-b491-4d8c-a2ee-02e3c2fe24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:27.896214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fcb5e-b491-4d8c-a2ee-02e3c2fe24da admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.896490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fcb5e-b491-4d8c-a2ee-02e3c2fe24da admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.896760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fcb5e-b491-4d8c-a2ee-02e3c2fe24da admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.897420 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fcb5e-b491-4d8c-a2ee-02e3c2fe24da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.899024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fcb5e-b491-4d8c-a2ee-02e3c2fe24da admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.906657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42dd73dfb5e45579ebb4bfe689dacea, user_id=b531d7ca59814d359b30264d2c9f7116, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:27.907881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:10:27.907881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:10:27.907881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:10:27.909985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:27.910449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 808/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:27.911972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e545c-0d61-40d6-b96b-fa115e7ff4b3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:27.912368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e545c-0d61-40d6-b96b-fa115e7ff4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:27.912663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e545c-0d61-40d6-b96b-fa115e7ff4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:27.926223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 788/1596] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:27 2022] PUT /identity/v3/projects/e42dd73dfb5e45579ebb4bfe689dacea/users/b531d7ca59814d359b30264d2c9f7116/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:27.930045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:27.954820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c16e545c-0d61-40d6-b96b-fa115e7ff4b3 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:27.956071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c16e545c-0d61-40d6-b96b-fa115e7ff4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:27.970258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:27.994724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e75e-4f95-4682-b1e7-e3234f7f4b5a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:27.999804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.000408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.000688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.000957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.001596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.003189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.017007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 789/1597] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:28.021121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.029717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 809/1598] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 08:10:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.031142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290bb04-f679-481b-8d32-9ecfbd1e2ab5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.031446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290bb04-f679-481b-8d32-9ecfbd1e2ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.031744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290bb04-f679-481b-8d32-9ecfbd1e2ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.032631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152a24-2cec-4482-b791-78ad8c6dbfc3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.037804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.038384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.038658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.039002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.039719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.041765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.043103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:28.057266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 790/1599] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:28.057266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.060402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d290bb04-f679-481b-8d32-9ecfbd1e2ab5 None None] MFA Rules not processed for user `671a6dbc4ff14f9086f34208acb36e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:28.061725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d290bb04-f679-481b-8d32-9ecfbd1e2ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.065201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15b2e-9036-49da-96df-c16ffe96f3cd admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.069818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.070405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.070674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.070937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.071598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.073170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.084751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 791/1600] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:28.085662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.095990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae044383-bcea-478e-bd81-43116e5f2581 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.100753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b0b8e-29fa-4728-b31b-88763ce10b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.101382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0b8e-29fa-4728-b31b-88763ce10b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.101657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0b8e-29fa-4728-b31b-88763ce10b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.101925 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0b8e-29fa-4728-b31b-88763ce10b26 admin admin] PATH_INFO: `/v3/projects/884ef55f39ac4aabb5a21dad94e7058a/users/415b9de52afe4122b65ce6adeaab16b9/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.116978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b0b8e-29fa-4728-b31b-88763ce10b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884ef55f39ac4aabb5a21dad94e7058a, user_id=415b9de52afe4122b65ce6adeaab16b9, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.119685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b0b8e-29fa-4728-b31b-88763ce10b26 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.132259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 810/1601] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.132259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290bb04-f679-481b-8d32-9ecfbd1e2ab5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.133643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 792/1602] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:28 2022] PUT /identity/v3/projects/884ef55f39ac4aabb5a21dad94e7058a/users/415b9de52afe4122b65ce6adeaab16b9/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:28.137165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d454e-3e3f-45a8-8609-c4f5883f32de None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.137165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d454e-3e3f-45a8-8609-c4f5883f32de None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.137165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d454e-3e3f-45a8-8609-c4f5883f32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.141765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290bb04-f679-481b-8d32-9ecfbd1e2ab5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.155765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-352d454e-3e3f-45a8-8609-c4f5883f32de None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:28.156970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-352d454e-3e3f-45a8-8609-c4f5883f32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.203559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.204288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.204591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.204859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.205496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.207114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.216202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 793/1603] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.217892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d454e-3e3f-45a8-8609-c4f5883f32de None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.218734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 811/1604] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:28.219655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.230378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d454e-3e3f-45a8-8609-c4f5883f32de None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.235365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.236052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.236328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.236600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] PATH_INFO: `/v3/projects/6e7fb2c8c8794ae19d1e9be460ea91bd/users/4cd431767adb4fbe8d17de4c56915d9a/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.251324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7fb2c8c8794ae19d1e9be460ea91bd, user_id=4cd431767adb4fbe8d17de4c56915d9a, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.253978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.264529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:28.271668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 794/1605] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:28 2022] PUT /identity/v3/projects/6e7fb2c8c8794ae19d1e9be460ea91bd/users/4cd431767adb4fbe8d17de4c56915d9a/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:28.271668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.298301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854c99d-6dd8-48b8-bc41-726d6cd14ce4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.334501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8546d4-6029-4c2b-9874-d0c7cf9969b8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.339001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.339687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.339961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.340227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] PATH_INFO: `/v3/projects/266cfb5a10ef4f0392a9f4eec0843943/users/1b6dc1cd41d04b90a459ad919bc73e70/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.356142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266cfb5a10ef4f0392a9f4eec0843943, user_id=1b6dc1cd41d04b90a459ad919bc73e70, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.359106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.364960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.365698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.365982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.366256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.373444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 795/1606] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:28 2022] PUT /identity/v3/projects/266cfb5a10ef4f0392a9f4eec0843943/users/1b6dc1cd41d04b90a459ad919bc73e70/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:28.374298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.403361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:28.425949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.427583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.437923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 812/1607] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:28.438751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.447038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5002e9-6fff-4897-bde2-f9fee3e0a007 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.449258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336272-e054-46cc-9646-d952349dbc61 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.452436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf93179-792e-40ae-b23e-4b70907d428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.453168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf93179-792e-40ae-b23e-4b70907d428f admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.453523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf93179-792e-40ae-b23e-4b70907d428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.453872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf93179-792e-40ae-b23e-4b70907d428f admin admin] PATH_INFO: `/v3/projects/d9907f1bb0c44faba482012b82fa11a7/users/255fff8ed1814e71b1d9504b4e4b887d/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.455108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.455838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.456181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.456519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.457199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.459191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.469365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf93179-792e-40ae-b23e-4b70907d428f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9907f1bb0c44faba482012b82fa11a7, user_id=255fff8ed1814e71b1d9504b4e4b887d, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.472195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf93179-792e-40ae-b23e-4b70907d428f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.486916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 796/1608] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:28 2022] PUT /identity/v3/projects/d9907f1bb0c44faba482012b82fa11a7/users/255fff8ed1814e71b1d9504b4e4b887d/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:28.488432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb187a3-19d2-41f7-a32b-62b996c5ec30 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.488769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb187a3-19d2-41f7-a32b-62b996c5ec30 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.489349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb187a3-19d2-41f7-a32b-62b996c5ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.489466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 813/1609] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:28.490168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.510060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0bb187a3-19d2-41f7-a32b-62b996c5ec30 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:28.511808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0bb187a3-19d2-41f7-a32b-62b996c5ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.549665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:28.564231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3764a1-cdf0-40fd-8498-df80a55008c5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.570911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9112c6d-70cb-4cad-82f2-ae7763f30183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.571683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112c6d-70cb-4cad-82f2-ae7763f30183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.572043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112c6d-70cb-4cad-82f2-ae7763f30183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.572384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112c6d-70cb-4cad-82f2-ae7763f30183 admin admin] PATH_INFO: `/v3/projects/1a59c78c38a04be7a88b6b2d5fc2508a/users/7e2d039823e64703a62623adb8eb0261/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.584610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 797/1610] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.585367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb187a3-19d2-41f7-a32b-62b996c5ec30 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.588281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9112c6d-70cb-4cad-82f2-ae7763f30183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a59c78c38a04be7a88b6b2d5fc2508a, user_id=7e2d039823e64703a62623adb8eb0261, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.591083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9112c6d-70cb-4cad-82f2-ae7763f30183 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.605735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 814/1611] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:28 2022] PUT /identity/v3/projects/1a59c78c38a04be7a88b6b2d5fc2508a/users/7e2d039823e64703a62623adb8eb0261/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:28.607183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788f24-0120-4b88-a5cf-6f8941dbbb18 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.607927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788f24-0120-4b88-a5cf-6f8941dbbb18 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.608500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788f24-0120-4b88-a5cf-6f8941dbbb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.628215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f6788f24-0120-4b88-a5cf-6f8941dbbb18 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:28.629419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f6788f24-0120-4b88-a5cf-6f8941dbbb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.654752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb187a3-19d2-41f7-a32b-62b996c5ec30 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.693750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 815/1612] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.694997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02fad-520a-44ec-9d5a-a177066445f6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.695278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02fad-520a-44ec-9d5a-a177066445f6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.695596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02fad-520a-44ec-9d5a-a177066445f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.710668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.711270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.711572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.711856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.721651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.723164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.725803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-44a02fad-520a-44ec-9d5a-a177066445f6 None None] MFA Rules not processed for user `1b6dc1cd41d04b90a459ad919bc73e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:28.727088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-44a02fad-520a-44ec-9d5a-a177066445f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.733458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 798/1613] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:28.734126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.738691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:28.744750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f0bf-c0fd-469f-b100-24b9bad9d5b6 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.751392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2c219-d1d9-4d19-808d-b6ec957e93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.752082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c219-d1d9-4d19-808d-b6ec957e93c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.752461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c219-d1d9-4d19-808d-b6ec957e93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.752867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c219-d1d9-4d19-808d-b6ec957e93c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.753601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2c219-d1d9-4d19-808d-b6ec957e93c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.755781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2c219-d1d9-4d19-808d-b6ec957e93c7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.780839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 799/1614] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:28.780839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e50ce-a6d6-4c6a-bef9-2ca34982a028 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.780839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e50ce-a6d6-4c6a-bef9-2ca34982a028 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.780839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e50ce-a6d6-4c6a-bef9-2ca34982a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.811634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cf8e50ce-a6d6-4c6a-bef9-2ca34982a028 None None] MFA Rules not processed for user `255fff8ed1814e71b1d9504b4e4b887d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:28.813537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cf8e50ce-a6d6-4c6a-bef9-2ca34982a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.818190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 816/1615] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.819259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02fad-520a-44ec-9d5a-a177066445f6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.831311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02fad-520a-44ec-9d5a-a177066445f6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.837070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d13a-8763-4b93-8ad7-bb527ef9b2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.837790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d13a-8763-4b93-8ad7-bb527ef9b2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.838074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d13a-8763-4b93-8ad7-bb527ef9b2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.838348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d13a-8763-4b93-8ad7-bb527ef9b2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.848693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d13a-8763-4b93-8ad7-bb527ef9b2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.850123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d13a-8763-4b93-8ad7-bb527ef9b2a8 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.861456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 817/1616] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:28.862727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.863014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.863290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.886724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:28.888283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.899847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 818/1617] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.904133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.905805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:28.911580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 800/1618] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:28.913552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cfa47-f537-4813-8437-5584f5f3a0e8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.914880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cfa47-f537-4813-8437-5584f5f3a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.915369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cfa47-f537-4813-8437-5584f5f3a0e8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.916958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 801/1619] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 08:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:10:28.918097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cfa47-f537-4813-8437-5584f5f3a0e8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.932643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6ba8a-9b70-46b9-b4a4-f406e16dfbf0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.935944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cfa47-f537-4813-8437-5584f5f3a0e8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:28.942319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a5352-c687-426f-a187-4f06607f556f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.942502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:28.943029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.943166 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5352-c687-426f-a187-4f06607f556f service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.943345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.943489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5352-c687-426f-a187-4f06607f556f service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.943735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5352-c687-426f-a187-4f06607f556f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.943854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:28.944295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.946051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.957331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5352-c687-426f-a187-4f06607f556f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:28.959038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5352-c687-426f-a187-4f06607f556f service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:28.961529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 802/1620] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:28.962640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:28.972980 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 819/1621] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:28.974273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24b89-7dc2-469f-8996-17511ae9a4b6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:28.974644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24b89-7dc2-469f-8996-17511ae9a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:28.974933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24b89-7dc2-469f-8996-17511ae9a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.008188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-18a24b89-7dc2-469f-8996-17511ae9a4b6 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:29.009483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-18a24b89-7dc2-469f-8996-17511ae9a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:29.060766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:29.084051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9265f-944d-43e3-bfbe-68f723e2c6e9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.092099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.094109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.094711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.095285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.111653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.114873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.130375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 803/1622] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:29.131848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.145638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 820/1623] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:29.149414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9799c-867b-4df2-b491-fae8b25a33e9 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.150843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9799c-867b-4df2-b491-fae8b25a33e9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.151001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9799c-867b-4df2-b491-fae8b25a33e9 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.165720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebddb37-9477-42fa-9529-b9fc0df9877b service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.172905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.173335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 821/1624] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 08:10:29 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:10:29.173860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.174362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.174754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.175330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9799c-867b-4df2-b491-fae8b25a33e9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.191349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.195161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.210902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 804/1625] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:29.211509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9799c-867b-4df2-b491-fae8b25a33e9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.212130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.223048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.225221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.226125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5539514-9098-409a-bf57-2444312d4e4d service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.226941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.227243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] PATH_INFO: `/v3/projects/e6ed434170f643b584b8d1fa47cbed54/users/c06ef8b994e3479db526b86621a99a29/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.230911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e4ba-32b4-499c-8216-877fdd362356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.231833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e4ba-32b4-499c-8216-877fdd362356 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.233100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e4ba-32b4-499c-8216-877fdd362356 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.233703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e4ba-32b4-499c-8216-877fdd362356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.246910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e4ba-32b4-499c-8216-877fdd362356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.249005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e4ba-32b4-499c-8216-877fdd362356 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.265091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ed434170f643b584b8d1fa47cbed54, user_id=c06ef8b994e3479db526b86621a99a29, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.270163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.276176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 805/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:29.279856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68bea-1bdb-49dd-8913-d489b1cb6ea1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.280145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68bea-1bdb-49dd-8913-d489b1cb6ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.280426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68bea-1bdb-49dd-8913-d489b1cb6ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.319228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 822/1627] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:29 2022] PUT /identity/v3/projects/e6ed434170f643b584b8d1fa47cbed54/users/c06ef8b994e3479db526b86621a99a29/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:29.322401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.338712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-bad68bea-1bdb-49dd-8913-d489b1cb6ea1 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:29.343078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bad68bea-1bdb-49dd-8913-d489b1cb6ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:29.464364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:29.479708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72701de-9733-4262-a7f0-573a6f929794 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.491644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.493600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.494249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.494990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.495940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.502016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.530798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 823/1628] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:29.532831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.550177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 806/1629] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:29.558489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68bea-1bdb-49dd-8913-d489b1cb6ea1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:29.565765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afca7ee-b8b9-4d9b-8673-9ad297cae352 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.577680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cffd-7bf8-402b-9ca1-b6273f859dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.578366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cffd-7bf8-402b-9ca1-b6273f859dde admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.578649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cffd-7bf8-402b-9ca1-b6273f859dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.578926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cffd-7bf8-402b-9ca1-b6273f859dde admin admin] PATH_INFO: `/v3/projects/e6ed434170f643b584b8d1fa47cbed54/users/c06ef8b994e3479db526b86621a99a29/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.580689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68bea-1bdb-49dd-8913-d489b1cb6ea1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:29.585317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50cffd-7bf8-402b-9ca1-b6273f859dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ed434170f643b584b8d1fa47cbed54, user_id=c06ef8b994e3479db526b86621a99a29, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.593176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50cffd-7bf8-402b-9ca1-b6273f859dde admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.597610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:29.598866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.599151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.599459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.615833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 824/1630] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:29 2022] PUT /identity/v3/projects/e6ed434170f643b584b8d1fa47cbed54/users/c06ef8b994e3479db526b86621a99a29/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:29.633136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd78ce-482b-4e48-a719-d855f3c8f34d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:29.633630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd78ce-482b-4e48-a719-d855f3c8f34d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:29.634710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd78ce-482b-4e48-a719-d855f3c8f34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:29.738588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dcbd78ce-482b-4e48-a719-d855f3c8f34d None None] MFA Rules not processed for user `c06ef8b994e3479db526b86621a99a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:29.746129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dcbd78ce-482b-4e48-a719-d855f3c8f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:29.806728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:29.812099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:29.848559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 807/1631] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:29.960657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 825/1632] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:30.231625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.388728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701192ab-6d60-4ff8-8757-f1e15d0059ac service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.423541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afac6d-159d-44db-af67-1d2f0becb057 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.424377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afac6d-159d-44db-af67-1d2f0becb057 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.424377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afac6d-159d-44db-af67-1d2f0becb057 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.426100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 826/1633] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 08:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:10:30.447907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a19cd-758c-463d-9ded-6836cc191f72 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.448187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a19cd-758c-463d-9ded-6836cc191f72 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.448457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a19cd-758c-463d-9ded-6836cc191f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.478275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:30.492430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d46a19cd-758c-463d-9ded-6836cc191f72 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:30.495635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d46a19cd-758c-463d-9ded-6836cc191f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:30.519303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.520172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.520703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.521175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.546226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:30.548364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:30.585097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 808/1634] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:30.669603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 827/1635] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:10:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:30.746821 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:30.759167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602d018-a989-403e-b155-17bb78212a05 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:30.767643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1cc9-1a40-4668-9ddb-dd77b79db7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:30.768455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1cc9-1a40-4668-9ddb-dd77b79db7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:30.768771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1cc9-1a40-4668-9ddb-dd77b79db7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:30.769163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1cc9-1a40-4668-9ddb-dd77b79db7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:30.798116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e1cc9-1a40-4668-9ddb-dd77b79db7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:30.799917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e1cc9-1a40-4668-9ddb-dd77b79db7a3 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:30.823368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 809/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:31.096454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a19cd-758c-463d-9ded-6836cc191f72 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.262376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a19cd-758c-463d-9ded-6836cc191f72 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.277314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.279117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.279451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.279769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] PATH_INFO: `/v3/users/255fff8ed1814e71b1d9504b4e4b887d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.282769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255fff8ed1814e71b1d9504b4e4b887d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.285119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.412955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255fff8ed1814e71b1d9504b4e4b887d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.414077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255fff8ed1814e71b1d9504b4e4b887d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.471179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255fff8ed1814e71b1d9504b4e4b887d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.472708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255fff8ed1814e71b1d9504b4e4b887d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.497095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255fff8ed1814e71b1d9504b4e4b887d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.531999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 828/1637] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:31 2022] DELETE /identity/v3/users/255fff8ed1814e71b1d9504b4e4b887d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:31.536386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.536910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.536910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.571013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.573078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.580183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:31.581403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.608588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:31.610316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:31.701864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ca71b-ccd8-4e24-a3f5-9caaa3cd1ea1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.715230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.715914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.716381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.716642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] PATH_INFO: `/v3/users/671a6dbc4ff14f9086f34208acb36e80` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.719354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=671a6dbc4ff14f9086f34208acb36e80)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.721338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.726567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 810/1638] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:31.749015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:31.750858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.815371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671a6dbc4ff14f9086f34208acb36e80'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.816306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671a6dbc4ff14f9086f34208acb36e80'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.872989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671a6dbc4ff14f9086f34208acb36e80'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.875193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671a6dbc4ff14f9086f34208acb36e80'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.891047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9706d-bf82-4de8-b458-e91b961fcc96 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:31.897780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4e76ffa1-0a4c-432c-9d58-f56f38cd5c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671a6dbc4ff14f9086f34208acb36e80'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:31.899354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:31.900133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.900610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.900996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:31.903168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:31.925757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:31.929009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:31.945089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 829/1639] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:31 2022] DELETE /identity/v3/users/671a6dbc4ff14f9086f34208acb36e80 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:31.954493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 811/1640] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:31.957285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:31.957574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:31.959391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.002557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:32.004674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:32.120975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 830/1641] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:32.157922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:32.159671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:32.184433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4942f3-9264-4894-b0f4-5196411164ce service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:32.250400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8d4e-9fad-4a07-a9d2-bc5a3850fce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:32.251447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8d4e-9fad-4a07-a9d2-bc5a3850fce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:32.251716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8d4e-9fad-4a07-a9d2-bc5a3850fce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:32.252094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8d4e-9fad-4a07-a9d2-bc5a3850fce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:32.262692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8d4e-9fad-4a07-a9d2-bc5a3850fce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:32.264501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8d4e-9fad-4a07-a9d2-bc5a3850fce3 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:32.276211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 812/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:33.099355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.101032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:33.133734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc2fd-76b7-4849-a179-35f23983e335 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.148440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.149106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.149389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.149666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] PATH_INFO: `/v3/projects/d9907f1bb0c44faba482012b82fa11a7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.152599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9907f1bb0c44faba482012b82fa11a7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.153636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:10:33.153636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: warnings.warn(msg) Aug 10 08:10:33.153636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: Aug 10 08:10:33.155542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.252563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:33.363726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9907f1bb0c44faba482012b82fa11a7', 'request_id': 'req-874958ae-0f82-4ada-ae00-dd32934f8615'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:33.404530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9907f1bb0c44faba482012b82fa11a7', 'request_id': 'req-874958ae-0f82-4ada-ae00-dd32934f8615'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:33.421143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9907f1bb0c44faba482012b82fa11a7', 'request_id': 'req-874958ae-0f82-4ada-ae00-dd32934f8615'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:33.451868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] The token cache is being invalidate because project d9907f1bb0c44faba482012b82fa11a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:33.452088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:33.453459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-874958ae-0f82-4ada-ae00-dd32934f8615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:33.456765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 831/1643] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:33 2022] DELETE /identity/v3/projects/d9907f1bb0c44faba482012b82fa11a7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:33.461548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57180-0509-4708-8483-2b8a7e4e9a6c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.462044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57180-0509-4708-8483-2b8a7e4e9a6c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.462137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57180-0509-4708-8483-2b8a7e4e9a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.491873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-34a57180-0509-4708-8483-2b8a7e4e9a6c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:33.496933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-34a57180-0509-4708-8483-2b8a7e4e9a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:33.631240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 813/1644] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:33.645003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e1d0-1f30-4d99-8e7c-04ab5f6c9850 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.645391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e1d0-1f30-4d99-8e7c-04ab5f6c9850 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.645878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e1d0-1f30-4d99-8e7c-04ab5f6c9850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.707526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ca02e1d0-1f30-4d99-8e7c-04ab5f6c9850 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:33.708962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ca02e1d0-1f30-4d99-8e7c-04ab5f6c9850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:33.727698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57180-0509-4708-8483-2b8a7e4e9a6c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.736079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:33.740682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 832/1645] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:33.743799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57180-0509-4708-8483-2b8a7e4e9a6c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.750058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.751690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.752233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.752423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.753663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:33.753663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.758193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.804077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02e1d0-1f30-4d99-8e7c-04ab5f6c9850 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.811459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 814/1646] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:33.816250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02e1d0-1f30-4d99-8e7c-04ab5f6c9850 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.825980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.828697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:33.836309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.836948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.837228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.839605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.841675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.846703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.865847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df61004-95a6-4992-8595-df0eb3338b93 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:33.881497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:33.882197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:33.883699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:33.883987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] PATH_INFO: `/v3/users/9df68913f85d427a8be1772b634a0b60` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:33.887335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df68913f85d427a8be1772b634a0b60)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:33.889378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:10:33.889378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: warnings.warn(msg) Aug 10 08:10:33.889378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: Aug 10 08:10:33.898505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:33.952703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 833/1647] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:33 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:33.954799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:33.957825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.118731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df68913f85d427a8be1772b634a0b60'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.183795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20555b5f-9315-4563-8c1d-31c1ca1def22 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:34.201960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:34.204195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.205080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df68913f85d427a8be1772b634a0b60'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.205425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.205837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] PATH_INFO: `/v3/projects/3ecbac5606e6423195fa38088b0a88c6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.207520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecbac5606e6423195fa38088b0a88c6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:34.212004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:34.233160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df68913f85d427a8be1772b634a0b60'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.234238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df68913f85d427a8be1772b634a0b60'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.234875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df68913f85d427a8be1772b634a0b60'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.265402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 815/1648] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:33 2022] DELETE /identity/v3/users/9df68913f85d427a8be1772b634a0b60 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:34.265402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:34.268704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.317276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecbac5606e6423195fa38088b0a88c6', 'request_id': 'req-f2d31d43-0f91-4d63-a8aa-658baa088d52'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.324719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecbac5606e6423195fa38088b0a88c6', 'request_id': 'req-f2d31d43-0f91-4d63-a8aa-658baa088d52'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.346833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecbac5606e6423195fa38088b0a88c6', 'request_id': 'req-f2d31d43-0f91-4d63-a8aa-658baa088d52'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.372364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] The token cache is being invalidate because project 3ecbac5606e6423195fa38088b0a88c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:34.372861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.375020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f2d31d43-0f91-4d63-a8aa-658baa088d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.382167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 834/1649] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:33 2022] DELETE /identity/v3/projects/3ecbac5606e6423195fa38088b0a88c6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:34.384042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.384323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.384960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.439639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:34.440898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.463197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b5117-8b0f-49b0-a58d-351d7cdd110c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:34.492930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:34.619667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 835/1650] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:34.623547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:34.625977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:34.626989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.627228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.627535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.628171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:34.630147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.635050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:34.655401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ad4f-0ccd-4128-b367-53bab3a343a3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:34.669065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:34.669375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:34.672777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.673120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.673394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] PATH_INFO: `/v3/users/c06ef8b994e3479db526b86621a99a29` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.675791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06ef8b994e3479db526b86621a99a29)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:34.683065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:34.685743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 816/1651] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:34 2022] POST /identity/v3/users => generated 301 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:34.690101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:34.694364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.846251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06ef8b994e3479db526b86621a99a29'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.847957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06ef8b994e3479db526b86621a99a29'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.942027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d2c5-94fa-452e-b406-4cca3d0184d1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:34.952748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06ef8b994e3479db526b86621a99a29'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.953705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06ef8b994e3479db526b86621a99a29'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:34.957901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:34.958565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:34.958817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:34.959115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:34.967766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:34.981569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06ef8b994e3479db526b86621a99a29'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:35.051551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 836/1652] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:34 2022] DELETE /identity/v3/users/c06ef8b994e3479db526b86621a99a29 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:35.051551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:35.065943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:35.069181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:35.074987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:35.143359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 817/1653] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:35.319277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2b3bd-b9c1-4613-8a42-d4f9faf8b73f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:35.336677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:35.339736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:35.340128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:35.341954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:35.342965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:35.347859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:35.379880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 837/1654] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:35.382886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:35.416477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7953eef-73e3-4e8a-8e78-6c93b7bd8fdb service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:35.438614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b8f16-66f9-4661-b2e4-7ccd9cfca327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:35.440803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8f16-66f9-4661-b2e4-7ccd9cfca327 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:35.442278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8f16-66f9-4661-b2e4-7ccd9cfca327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:35.442590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8f16-66f9-4661-b2e4-7ccd9cfca327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:35.451635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b8f16-66f9-4661-b2e4-7ccd9cfca327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:35.451635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b8f16-66f9-4661-b2e4-7ccd9cfca327 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:35.489199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:35.489928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 818/1655] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:35.511923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54337050-59f3-4e31-9308-70496bb07882 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:35.522376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:35.523068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:35.523346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:35.523647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] PATH_INFO: `/v3/projects/4236c327bde34702b911c18d4a49fc6c/users/2f1c540f3340464b9a0ba279227705a2/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:35.568042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4236c327bde34702b911c18d4a49fc6c, user_id=2f1c540f3340464b9a0ba279227705a2, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:35.580225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:35.598162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 838/1656] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:35 2022] PUT /identity/v3/projects/4236c327bde34702b911c18d4a49fc6c/users/2f1c540f3340464b9a0ba279227705a2/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:35.609605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c5d2-69d6-441d-9573-507e1a4cf1e8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:35.610550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c5d2-69d6-441d-9573-507e1a4cf1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:35.610907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c5d2-69d6-441d-9573-507e1a4cf1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:35.674967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c2e6c5d2-69d6-441d-9573-507e1a4cf1e8 None None] MFA Rules not processed for user `2f1c540f3340464b9a0ba279227705a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:35.676500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c2e6c5d2-69d6-441d-9573-507e1a4cf1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:35.924366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 819/1657] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:35.926050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:35.948064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:36.068071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8738e4e-0ef6-4679-ad0b-e6cc5d3a863e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:36.078562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:36.079930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:36.080761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:36.081397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:36.082716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:36.090757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:36.163604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 839/1658] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:35 2022] POST /identity/v3/projects => generated 399 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:36.164766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c5d2-69d6-441d-9573-507e1a4cf1e8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:36.190206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c5d2-69d6-441d-9573-507e1a4cf1e8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:36.330371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:36.331008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:36.331292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:36.331599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:36.332256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:36.334244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:36.434117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 820/1659] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:36 2022] POST /identity/v3/users => generated 306 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:36.438772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:36.480969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242610-c33a-4053-9084-8c1c312ea4b5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:36.507287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:36.508872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:36.514805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:36.516785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:36.517712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:36.519631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:36.576133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:36.586627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b993-da09-4b2a-879c-b1c37df222b4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:36.592205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 840/1660] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:36.608888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:36.609757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:36.610196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:36.610614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] PATH_INFO: `/v3/projects/e33d0106a2304010a3aacdf0199457fc/users/08ba781365344ebe8c4fe4a26385850b/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:36.623798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:36.665694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33d0106a2304010a3aacdf0199457fc, user_id=08ba781365344ebe8c4fe4a26385850b, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:36.669142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:36.724649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 821/1661] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:36 2022] PUT /identity/v3/projects/e33d0106a2304010a3aacdf0199457fc/users/08ba781365344ebe8c4fe4a26385850b/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:36.726112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:36.750215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715bc86-a3ad-47dc-aea1-fdbd1c275af4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.024872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2625f66-46f9-41e2-b9cf-f7c98de3e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.025621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625f66-46f9-41e2-b9cf-f7c98de3e09f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.026006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625f66-46f9-41e2-b9cf-f7c98de3e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.026381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625f66-46f9-41e2-b9cf-f7c98de3e09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.027408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2625f66-46f9-41e2-b9cf-f7c98de3e09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.029682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2625f66-46f9-41e2-b9cf-f7c98de3e09f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.082210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.099800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 841/1662] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:37.102180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f075e6-d9d5-446e-af0e-8994d87f2811 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.115027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.119218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.119530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.119815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] PATH_INFO: `/v3/projects/e33d0106a2304010a3aacdf0199457fc/users/08ba781365344ebe8c4fe4a26385850b/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.136389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33d0106a2304010a3aacdf0199457fc, user_id=08ba781365344ebe8c4fe4a26385850b, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.139966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.189128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 822/1663] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:37 2022] PUT /identity/v3/projects/e33d0106a2304010a3aacdf0199457fc/users/08ba781365344ebe8c4fe4a26385850b/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:37.193900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.194189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.194463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.229716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.231681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.256458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] MFA Rules not processed for user `08ba781365344ebe8c4fe4a26385850b`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:37.259828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.406545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 842/1664] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:37.410592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec9ce-e18a-4b57-8ec5-1039ec59126e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.417531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.422167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.423089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.426107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.426504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.426877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] PATH_INFO: `/v3/projects/e6ed434170f643b584b8d1fa47cbed54` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.431969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ed434170f643b584b8d1fa47cbed54)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.432770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:37.447717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.552087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb4b8f-522a-47e3-a505-983e4267740f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.570283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ed434170f643b584b8d1fa47cbed54', 'request_id': 'req-be7a7f26-2403-4828-835a-48d2707cd8bc'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.589506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ed434170f643b584b8d1fa47cbed54', 'request_id': 'req-be7a7f26-2403-4828-835a-48d2707cd8bc'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.618895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ed434170f643b584b8d1fa47cbed54', 'request_id': 'req-be7a7f26-2403-4828-835a-48d2707cd8bc'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.633889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] The token cache is being invalidate because project e6ed434170f643b584b8d1fa47cbed54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:37.634203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.635262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-be7a7f26-2403-4828-835a-48d2707cd8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:37.637394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 823/1665] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:37 2022] DELETE /identity/v3/projects/e6ed434170f643b584b8d1fa47cbed54 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:37.642971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.644372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.644730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.659754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f076410-21f2-4372-a31d-57d73f964c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.660632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f076410-21f2-4372-a31d-57d73f964c57 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.660900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f076410-21f2-4372-a31d-57d73f964c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.661169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f076410-21f2-4372-a31d-57d73f964c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.670635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8f076410-21f2-4372-a31d-57d73f964c57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.689008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:37.693854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.835061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f076410-21f2-4372-a31d-57d73f964c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.836591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f076410-21f2-4372-a31d-57d73f964c57 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.857542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 824/1666] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:37.857542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.857542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.862959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 843/1667] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:37.869247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622a28-536d-4655-8396-70c871bc15fd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.869539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622a28-536d-4655-8396-70c871bc15fd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.869813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622a28-536d-4655-8396-70c871bc15fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.873453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:37.882604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d07371-6186-4964-8e1d-5f574933b174 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.904641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.905299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.905576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.905846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] PATH_INFO: `/v3/projects/a26c40abe2ed4178aa9b7dafc68f0862` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.910574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26c40abe2ed4178aa9b7dafc68f0862)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.916019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:37.920973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-62622a28-536d-4655-8396-70c871bc15fd None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:37.925974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-62622a28-536d-4655-8396-70c871bc15fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:37.946446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 844/1668] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:37.951129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622a28-536d-4655-8396-70c871bc15fd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:37.966618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622a28-536d-4655-8396-70c871bc15fd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:37.984115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:37.985001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:37.985320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:37.985592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:37.991499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:37.992190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:37.993846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.029388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 845/1669] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:38.031038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26c40abe2ed4178aa9b7dafc68f0862', 'request_id': 'req-35bd5449-bb2b-44d0-99fd-39672f05bec6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.034533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.069804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26c40abe2ed4178aa9b7dafc68f0862', 'request_id': 'req-35bd5449-bb2b-44d0-99fd-39672f05bec6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.077647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26c40abe2ed4178aa9b7dafc68f0862', 'request_id': 'req-35bd5449-bb2b-44d0-99fd-39672f05bec6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.093628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb139-1437-4a86-b157-2cd897ce75fe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.099141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] The token cache is being invalidate because project a26c40abe2ed4178aa9b7dafc68f0862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:38.100790 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.101486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:38.103032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 825/1670] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:37 2022] DELETE /identity/v3/projects/a26c40abe2ed4178aa9b7dafc68f0862 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:38.104324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.113428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.218993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:38.244914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec8b53-bfcc-4f25-8c6a-667781229ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.245552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec8b53-bfcc-4f25-8c6a-667781229ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.245832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec8b53-bfcc-4f25-8c6a-667781229ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.246105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec8b53-bfcc-4f25-8c6a-667781229ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.246804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec8b53-bfcc-4f25-8c6a-667781229ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.248846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec8b53-bfcc-4f25-8c6a-667781229ea7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.265106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5449-bb2b-44d0-99fd-39672f05bec6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.270151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.271313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.271831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.272322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.276537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.331873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 846/1671] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/projects => generated 363 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:38.335124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315417-762f-4290-9b44-62bb20235753 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.335591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315417-762f-4290-9b44-62bb20235753 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.337484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315417-762f-4290-9b44-62bb20235753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.381365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e4315417-762f-4290-9b44-62bb20235753 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:38.383968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e4315417-762f-4290-9b44-62bb20235753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.420946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.422414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.446132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 826/1672] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:38.446795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.448137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.489286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc381d9-1fa7-490d-b4fc-0b962271d17e service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.525624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 847/1673] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:38.537903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ea54-09f3-4470-b621-d995cbf2e072 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.538195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ea54-09f3-4470-b621-d995cbf2e072 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.538471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ea54-09f3-4470-b621-d995cbf2e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.601216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:38.604544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6f37ea54-09f3-4470-b621-d995cbf2e072 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:38.609305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6f37ea54-09f3-4470-b621-d995cbf2e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:38.641302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 848/1674] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:38.641964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.642628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.642961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.643151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.644836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ea54-09f3-4470-b621-d995cbf2e072 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.645826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.649281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.675844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ea54-09f3-4470-b621-d995cbf2e072 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.694548 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.697713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.699184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.700376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.701766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:38.702165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.716867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.717918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 827/1675] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/users => generated 282 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:38.722385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.751395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293d6e9-7347-4b56-940a-51309839948b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.766163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.767251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.767758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.768249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.769122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.771018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.775502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 849/1676] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:38.776676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.812305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 828/1677] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:38.813814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.814172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a818df-422f-4a0a-a1e4-174a55b04783 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.836167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.836747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.837025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.837304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.837939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.839901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.842358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c6ba-acfa-498b-9758-8b206f6f7a87 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:38.859557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:38.860564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:38.861056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:38.861526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:38.862381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:38.864733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:38.898660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 829/1678] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:38.900615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.918964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 850/1679] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:38.920530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:38.931602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e83c6d-52e3-4d9e-a6fc-ac36b69dd680 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.090652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db609395-061b-42b7-8462-38392b86e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.091549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609395-061b-42b7-8462-38392b86e6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.091943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609395-061b-42b7-8462-38392b86e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.092406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609395-061b-42b7-8462-38392b86e6e3 admin admin] PATH_INFO: `/v3/projects/af3aa24ea9d84fb48e734c8f1d81b919/users/3ca5059ed20040e88233b7c572989c66/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.121921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6876fe1-b010-40d2-a4a4-199e7d2bd98c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.138627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.139447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.139827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.140102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.140658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db609395-061b-42b7-8462-38392b86e6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3aa24ea9d84fb48e734c8f1d81b919, user_id=3ca5059ed20040e88233b7c572989c66, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.140781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.142667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.147128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db609395-061b-42b7-8462-38392b86e6e3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.190266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 851/1681] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:38 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:39.190538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 830/1681] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:38 2022] PUT /identity/v3/projects/af3aa24ea9d84fb48e734c8f1d81b919/users/3ca5059ed20040e88233b7c572989c66/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:39.191624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.197837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1eeec-3685-4335-8219-bb9d17b890b5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.198272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1eeec-3685-4335-8219-bb9d17b890b5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.198650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1eeec-3685-4335-8219-bb9d17b890b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.218951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f468d33-b838-41e7-a2f4-df48fee05276 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.264595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-bcc1eeec-3685-4335-8219-bb9d17b890b5 None None] MFA Rules not processed for user `3ca5059ed20040e88233b7c572989c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:39.267469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:39.267988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bcc1eeec-3685-4335-8219-bb9d17b890b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:39.395552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.397939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.402415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.402561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.406915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.410849 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.458580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 852/1682] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:39.459111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.485304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 831/1683] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:39.494907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1eeec-3685-4335-8219-bb9d17b890b5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.499567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c6e2-e738-4c6b-95e5-671f4ad3b1f5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.537729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.537892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.538041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.538315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.538969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.542378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.546727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1eeec-3685-4335-8219-bb9d17b890b5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.573181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.573898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.574184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.574455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.575113 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.577733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.590087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 853/1684] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:39.593569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.628800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc127-9a70-4206-b71f-6316ac209e26 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:39.642728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:39.655435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c754e5b-d513-42d1-b628-d818c25b3f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:39.655435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c754e5b-d513-42d1-b628-d818c25b3f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.655435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c754e5b-d513-42d1-b628-d818c25b3f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.655435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c754e5b-d513-42d1-b628-d818c25b3f09 admin admin] PATH_INFO: `/v3/projects/42fdb4078a04458a90d9ffe9c4b238a7/users/b8e522d396cd4b979b1468a8810177e8/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.677499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 832/1685] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:39 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:39.677757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:39.705158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c754e5b-d513-42d1-b628-d818c25b3f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fdb4078a04458a90d9ffe9c4b238a7, user_id=b8e522d396cd4b979b1468a8810177e8, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:39.707692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c754e5b-d513-42d1-b628-d818c25b3f09 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:39.759545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 854/1686] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:39 2022] PUT /identity/v3/projects/42fdb4078a04458a90d9ffe9c4b238a7/users/b8e522d396cd4b979b1468a8810177e8/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:39.761180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa786-3c79-4721-9dc7-029aaa7e6f51 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:39.761471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa786-3c79-4721-9dc7-029aaa7e6f51 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:39.761750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa786-3c79-4721-9dc7-029aaa7e6f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:39.848639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7ccaa786-3c79-4721-9dc7-029aaa7e6f51 None None] MFA Rules not processed for user `b8e522d396cd4b979b1468a8810177e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:39.849898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7ccaa786-3c79-4721-9dc7-029aaa7e6f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:39.884991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366712-4e1f-4e13-91a8-b108d22869c8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.040130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.040972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.041611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.042297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.043767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.046405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.078885 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 855/1687] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:40.079730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa786-3c79-4721-9dc7-029aaa7e6f51 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.082594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 833/1688] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:39 2022] POST /identity/v3/users => generated 289 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:40.087036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.102012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa786-3c79-4721-9dc7-029aaa7e6f51 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.105485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f14e50-9a8f-450c-88f4-7273d4ead273 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.108239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.110315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.111102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.111640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.111960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.112516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.112884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.113104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.113388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.114142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.115644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.116489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.133284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 834/1689] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:40.139811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.162793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 856/1690] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:40.166951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.173231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffd52-18c6-4ebe-98a4-ffe3af148b0b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.297270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.298586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.299062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.299623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] PATH_INFO: `/v3/projects/52a2ed87b3f247d2ac74311c26e38fad/users/0cf0a38770e54c6094f76107d3f65767/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.319602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:40.339344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a2ed87b3f247d2ac74311c26e38fad, user_id=0cf0a38770e54c6094f76107d3f65767, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.345891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.349995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961f3c-02d3-4e47-8550-7b0a4e04e1fb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.358175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.359123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.359623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.360474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.361256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.365054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.408111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 857/1691] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:10:40.411666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.412907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 835/1692] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:40 2022] PUT /identity/v3/projects/52a2ed87b3f247d2ac74311c26e38fad/users/0cf0a38770e54c6094f76107d3f65767/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:40.419234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.425460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106bf7-3288-4da8-8286-bd95397cb630 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.440891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:40.546708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc24ee-f44b-476f-ad46-690d3abe5e4d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.560523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.561289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.561905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.561905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.562573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.563187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.564172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.564692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.565292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.566307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.566488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.569836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.584591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 836/1693] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:40.590398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.595217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 858/1694] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:40.599910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.606288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791139b1-d6d2-4724-87e4-b1d59db63f39 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.612914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72c5da-a610-47a6-a8c0-26cc736ba4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.613522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72c5da-a610-47a6-a8c0-26cc736ba4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.613879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72c5da-a610-47a6-a8c0-26cc736ba4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.614182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72c5da-a610-47a6-a8c0-26cc736ba4d8 admin admin] PATH_INFO: `/v3/projects/52a2ed87b3f247d2ac74311c26e38fad/users/0cf0a38770e54c6094f76107d3f65767/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.616266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72c5da-a610-47a6-a8c0-26cc736ba4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a2ed87b3f247d2ac74311c26e38fad, user_id=0cf0a38770e54c6094f76107d3f65767, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.617097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2a93b-98d4-465b-b4d6-dcbdab11e784 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.619493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72c5da-a610-47a6-a8c0-26cc736ba4d8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.630112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.632100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.632522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.633229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] PATH_INFO: `/v3/projects/371a416a73eb439dba0975651687cac1/users/9ca34abf2c51447297c9e259a7069003/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.635138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 837/1695] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:40 2022] PUT /identity/v3/projects/52a2ed87b3f247d2ac74311c26e38fad/users/0cf0a38770e54c6094f76107d3f65767/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:40.650692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ffe2-18a0-4d9c-89c9-c3579ea8422d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.651346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ffe2-18a0-4d9c-89c9-c3579ea8422d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.651346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ffe2-18a0-4d9c-89c9-c3579ea8422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.658801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=371a416a73eb439dba0975651687cac1, user_id=9ca34abf2c51447297c9e259a7069003, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.662472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.688623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 859/1696] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:40 2022] PUT /identity/v3/projects/371a416a73eb439dba0975651687cac1/users/9ca34abf2c51447297c9e259a7069003/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:40.692361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.757642 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8377ffe2-18a0-4d9c-89c9-c3579ea8422d None None] MFA Rules not processed for user `0cf0a38770e54c6094f76107d3f65767`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:40.757781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8377ffe2-18a0-4d9c-89c9-c3579ea8422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:40.875754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cf6c6-ac3b-4f10-8dcb-ff6482a489ec admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.889089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.889797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.890194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.890557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.891317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.893910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.918944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 838/1697] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:40.927696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 860/1698] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:40.928402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ffe2-18a0-4d9c-89c9-c3579ea8422d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.937676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:40.948705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ffe2-18a0-4d9c-89c9-c3579ea8422d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:40.961748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ab431-b6fd-490b-9ecf-cd4952e08935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:40.962302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ab431-b6fd-490b-9ecf-cd4952e08935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:40.962587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ab431-b6fd-490b-9ecf-cd4952e08935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:40.962869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ab431-b6fd-490b-9ecf-cd4952e08935 admin admin] PATH_INFO: `/v3/projects/371a416a73eb439dba0975651687cac1/users/9ca34abf2c51447297c9e259a7069003/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:40.968134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ab431-b6fd-490b-9ecf-cd4952e08935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371a416a73eb439dba0975651687cac1, user_id=9ca34abf2c51447297c9e259a7069003, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:40.971115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ab431-b6fd-490b-9ecf-cd4952e08935 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:40.996920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 839/1699] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:40 2022] PUT /identity/v3/projects/371a416a73eb439dba0975651687cac1/users/9ca34abf2c51447297c9e259a7069003/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:41.009526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.009526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.009829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.068170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:41.077738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aa979-9165-41f6-a06c-997b9400e4da admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.079618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] MFA Rules not processed for user `9ca34abf2c51447297c9e259a7069003`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:41.088704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:41.179698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:41.186085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff623-65ae-49b8-91d0-10c963a3dbe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.186863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff623-65ae-49b8-91d0-10c963a3dbe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.187267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff623-65ae-49b8-91d0-10c963a3dbe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.188122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff623-65ae-49b8-91d0-10c963a3dbe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.216220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 840/1700] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:41.295339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.297418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:41.321824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d329d-d9c6-461f-8f6b-e8f7966d19f4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.335007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.335877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.336317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.336748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.358326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.364044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.373206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff623-65ae-49b8-91d0-10c963a3dbe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.379495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 841/1701] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:41.391645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff623-65ae-49b8-91d0-10c963a3dbe7 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.426878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 861/1702] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:41.693944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:41.704910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5de0-e064-4d7e-9eca-46b155c6d7f8 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:41.722511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6850-365a-42b7-a7e8-6fa0f642d8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:41.723271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6850-365a-42b7-a7e8-6fa0f642d8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:41.723577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6850-365a-42b7-a7e8-6fa0f642d8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:41.724210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6850-365a-42b7-a7e8-6fa0f642d8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:41.885442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de6850-365a-42b7-a7e8-6fa0f642d8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:41.887385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de6850-365a-42b7-a7e8-6fa0f642d8f9 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:41.922040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 842/1703] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:42.395193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10637ce5-2a6d-4d8d-ae24-4b9c082e3aef None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.399049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10637ce5-2a6d-4d8d-ae24-4b9c082e3aef None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.399377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10637ce5-2a6d-4d8d-ae24-4b9c082e3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.489465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-10637ce5-2a6d-4d8d-ae24-4b9c082e3aef None None] MFA Rules not processed for user `415b9de52afe4122b65ce6adeaab16b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:42.490765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-10637ce5-2a6d-4d8d-ae24-4b9c082e3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.635074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 862/1704] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:42.645100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.645377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.645651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.678751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10637ce5-2a6d-4d8d-ae24-4b9c082e3aef None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:42.682012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] MFA Rules not processed for user `415b9de52afe4122b65ce6adeaab16b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:42.689468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.705566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 843/1705] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:42.719081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:42.720772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.818650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:42.864011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10637ce5-2a6d-4d8d-ae24-4b9c082e3aef None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:42.883796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:42.883796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.883796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.883796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] PATH_INFO: `/v3/users/b8e522d396cd4b979b1468a8810177e8` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.884240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e522d396cd4b979b1468a8810177e8)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:42.884240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:42.901504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063b98-2819-4a11-b00c-a87cf4f8c279 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:42.912947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:42.914076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.914685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.915169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.928263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:42.930199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:42.941637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e522d396cd4b979b1468a8810177e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.942436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e522d396cd4b979b1468a8810177e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.945561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 844/1706] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:42.946760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:42.949218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:42.975224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f97d3-18e5-4fe9-b3b8-3439764e47fb service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:42.979396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e522d396cd4b979b1468a8810177e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.982469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:42.983085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e522d396cd4b979b1468a8810177e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:42.983603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:42.984053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:42.985170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] PATH_INFO: `/v3/users/1b6dc1cd41d04b90a459ad919bc73e70` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:42.987185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6dc1cd41d04b90a459ad919bc73e70)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:42.990461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:43.003231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c82d4074-68e6-48c1-be34-af1c1944498a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e522d396cd4b979b1468a8810177e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.026603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 863/1707] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:42 2022] DELETE /identity/v3/users/b8e522d396cd4b979b1468a8810177e8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:43.032250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.032840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.033282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.080494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:43.081799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:43.086079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:43.094576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6dc1cd41d04b90a459ad919bc73e70'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.149179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6dc1cd41d04b90a459ad919bc73e70'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.204783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6dc1cd41d04b90a459ad919bc73e70'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.206756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6dc1cd41d04b90a459ad919bc73e70'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.207907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6873fb7-dae7-4966-ae57-60b4db28a9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6dc1cd41d04b90a459ad919bc73e70'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:43.275289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 845/1708] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:42 2022] DELETE /identity/v3/users/1b6dc1cd41d04b90a459ad919bc73e70 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:43.277078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.277630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.278741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.290546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 864/1709] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:43.333616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:43.334881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:43.494501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 846/1710] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:43.574558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:43.576225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:43.614806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:43.616326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:43.782637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66192d6a-01b6-4689-9f21-cadc1efb57ba None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:43.797062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b32e0-985d-49d8-8d37-3f5306099086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:43.798077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b32e0-985d-49d8-8d37-3f5306099086 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.798577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b32e0-985d-49d8-8d37-3f5306099086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.799316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b32e0-985d-49d8-8d37-3f5306099086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.808285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770ec0a-0b39-4c73-a540-93af7ed4186c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:43.820288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:43.821214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.821709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.822216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b32e0-985d-49d8-8d37-3f5306099086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:43.822708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.824594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b32e0-985d-49d8-8d37-3f5306099086 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:43.849054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 865/1711] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:43.851164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f1db-0f08-415d-b231-c54f8c170315 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.851638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f1db-0f08-415d-b231-c54f8c170315 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.852051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f1db-0f08-415d-b231-c54f8c170315 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.855309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:43.857943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:43.859388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 866/1712] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 08:10:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:10:43.861071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:43.861660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:43.862191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:43.872098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 847/1713] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:10:43.900570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:43.993678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] MFA Rules not processed for user `465160a7e1c24601b83be37681ef322d`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:44.017225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.089121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 867/1714] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:44.178962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.190873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52f302-df6e-408d-9b85-7d5e33abaaf2 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.198890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532d633-d79d-418f-91ce-2e4d0a29e2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.203381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532d633-d79d-418f-91ce-2e4d0a29e2bc service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.204403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532d633-d79d-418f-91ce-2e4d0a29e2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.205832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532d633-d79d-418f-91ce-2e4d0a29e2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.257199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532d633-d79d-418f-91ce-2e4d0a29e2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.260584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532d633-d79d-418f-91ce-2e4d0a29e2bc service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.292853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 848/1715] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:44.440546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.444462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.476686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5a2c8-d0ae-41d0-8e84-995266e81f56 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:44.489594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:44.490216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.490500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.490768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] PATH_INFO: `/v3/users/2f1c540f3340464b9a0ba279227705a2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.492997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1c540f3340464b9a0ba279227705a2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:44.494974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:44.621055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1c540f3340464b9a0ba279227705a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.621791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1c540f3340464b9a0ba279227705a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.658781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1c540f3340464b9a0ba279227705a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.659583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1c540f3340464b9a0ba279227705a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.676385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1c540f3340464b9a0ba279227705a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:44.700046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 868/1716] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:44 2022] DELETE /identity/v3/users/2f1c540f3340464b9a0ba279227705a2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:44.705322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:44.706002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:44.706515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:44.770877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:44.775654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:44.876337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:44.888909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 849/1717] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:44.917961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:44.919541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.081028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc107cd-9f7e-4e92-b29c-57cd087e51e5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.094916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.096774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.101978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.103637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.105749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.106103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.119405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb678b-9273-474d-abed-8e175e739b50 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.135463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.136435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.136969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.137390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] PATH_INFO: `/v3/projects/42fdb4078a04458a90d9ffe9c4b238a7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.141766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fdb4078a04458a90d9ffe9c4b238a7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.142297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.143901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.146279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.164174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 869/1718] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:45.259759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fdb4078a04458a90d9ffe9c4b238a7', 'request_id': 'req-3e4b1742-996a-47d3-abc3-d4d96b730693'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.281460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fdb4078a04458a90d9ffe9c4b238a7', 'request_id': 'req-3e4b1742-996a-47d3-abc3-d4d96b730693'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.296910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fdb4078a04458a90d9ffe9c4b238a7', 'request_id': 'req-3e4b1742-996a-47d3-abc3-d4d96b730693'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.342768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] The token cache is being invalidate because project 42fdb4078a04458a90d9ffe9c4b238a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:45.343321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.351743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e4b1742-996a-47d3-abc3-d4d96b730693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.354536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 850/1719] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:45 2022] DELETE /identity/v3/projects/42fdb4078a04458a90d9ffe9c4b238a7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:45.359611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.372034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907722-ba9c-4550-bb2d-147c69d5ae76 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:45.521796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:45.522441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.522722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.523051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] PATH_INFO: `/v3/users/9ca34abf2c51447297c9e259a7069003` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.524206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca34abf2c51447297c9e259a7069003)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:45.526352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:45.529317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:45.653677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f612e-f398-4827-9811-38d0d90d0c8d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.654056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f612e-f398-4827-9811-38d0d90d0c8d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.654600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f612e-f398-4827-9811-38d0d90d0c8d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.656194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 851/1720] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 10 08:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:10:45.661816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de32d33-e0ce-48b4-bd01-21fd551f5f61 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.662129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de32d33-e0ce-48b4-bd01-21fd551f5f61 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.662686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de32d33-e0ce-48b4-bd01-21fd551f5f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:45.682067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca34abf2c51447297c9e259a7069003'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.683779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca34abf2c51447297c9e259a7069003'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.725393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca34abf2c51447297c9e259a7069003'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.727760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca34abf2c51447297c9e259a7069003'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.745431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0de32d33-e0ce-48b4-bd01-21fd551f5f61 None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:45.746766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0de32d33-e0ce-48b4-bd01-21fd551f5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:45.752653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca34abf2c51447297c9e259a7069003'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:45.783868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 870/1721] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:45 2022] DELETE /identity/v3/users/9ca34abf2c51447297c9e259a7069003 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:45.889134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 852/1722] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:45.900245 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:45.984926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:45.985210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:45.985655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.031402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] MFA Rules not processed for user `415b9de52afe4122b65ce6adeaab16b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:46.032756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.136364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea659ce-495e-48a7-b21b-f64a2434dd4f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.152952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.154940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.155396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.156085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.164092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.181473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 853/1723] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:46.182628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.184131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.185080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.198195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.234476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:46.250388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 871/1724] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:46.309104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.311330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.333586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c401a-cc35-487e-ac12-c63d53c017e1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.351288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.352066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.352236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.352786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] PATH_INFO: `/v3/users/3ca5059ed20040e88233b7c572989c66` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.354832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca5059ed20040e88233b7c572989c66)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.357367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.494614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca5059ed20040e88233b7c572989c66'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.525303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571900-6e39-4cf1-9dc6-d047c15760f2 service placement] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.537399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.538131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.538351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.538629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] PATH_INFO: `/v3/projects/4236c327bde34702b911c18d4a49fc6c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.539853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4236c327bde34702b911c18d4a49fc6c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:46.541355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca5059ed20040e88233b7c572989c66'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.542282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:46.583809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca5059ed20040e88233b7c572989c66'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.587244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca5059ed20040e88233b7c572989c66'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.588932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-43c90814-ee98-40a4-a027-63b25533d302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca5059ed20040e88233b7c572989c66'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.595313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:46.625345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 854/1725] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:46 2022] DELETE /identity/v3/users/3ca5059ed20040e88233b7c572989c66 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:46.628716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.629108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.629305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.682626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4236c327bde34702b911c18d4a49fc6c', 'request_id': 'req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.690515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4236c327bde34702b911c18d4a49fc6c', 'request_id': 'req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.701657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4236c327bde34702b911c18d4a49fc6c', 'request_id': 'req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.723886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] MFA Rules not processed for user `4cd431767adb4fbe8d17de4c56915d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:46.727078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.727625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] The token cache is being invalidate because project 4236c327bde34702b911c18d4a49fc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:46.727930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.732183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3214332-2bcf-49c8-8cc9-5f8460cd6e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:46.749943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 872/1726] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:46 2022] DELETE /identity/v3/projects/4236c327bde34702b911c18d4a49fc6c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:46.753267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:46.755937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:46.757294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:46.797576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:46.799042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.929946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 873/1727] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:46.934180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.938698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.952961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 855/1728] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:46.959845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:46.961358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:46.975323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd30e4-7e3b-4cea-8a8c-1daf7abe256d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:46.989440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:46.997954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.001131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.002751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] PATH_INFO: `/v3/users/08ba781365344ebe8c4fe4a26385850b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.006387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ba781365344ebe8c4fe4a26385850b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.012658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.081264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:47.189791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ba781365344ebe8c4fe4a26385850b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.191504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ba781365344ebe8c4fe4a26385850b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.222708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ba781365344ebe8c4fe4a26385850b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.224563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ba781365344ebe8c4fe4a26385850b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.238828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be81e-d579-43d6-9f44-5a153b073051 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.241106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ba781365344ebe8c4fe4a26385850b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.254052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.258440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.260656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.261236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.270237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 874/1729] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:46 2022] DELETE /identity/v3/users/08ba781365344ebe8c4fe4a26385850b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:47.271554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.272303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.277362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.296966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.298649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.323105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 856/1730] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:47.324801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:47.327202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:47.332367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.370214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66674655-8b91-456f-84d5-f14ae1ee304e service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.501223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5293514-ac85-4a87-9b07-c3caa11c436a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:47.517927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720e2fa-ce20-49c3-b9cf-b6bcdfd7055d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.520066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e2fa-ce20-49c3-b9cf-b6bcdfd7055d service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.521201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e2fa-ce20-49c3-b9cf-b6bcdfd7055d service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.522172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e2fa-ce20-49c3-b9cf-b6bcdfd7055d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.524072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:47.524741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.525730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.525730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] PATH_INFO: `/v3/projects/266cfb5a10ef4f0392a9f4eec0843943` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.530151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266cfb5a10ef4f0392a9f4eec0843943)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.535017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0720e2fa-ce20-49c3-b9cf-b6bcdfd7055d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:47.548242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.602127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720e2fa-ce20-49c3-b9cf-b6bcdfd7055d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:47.609394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720e2fa-ce20-49c3-b9cf-b6bcdfd7055d service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:47.643845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 875/1731] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:47.704533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266cfb5a10ef4f0392a9f4eec0843943', 'request_id': 'req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.721610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266cfb5a10ef4f0392a9f4eec0843943', 'request_id': 'req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.729104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266cfb5a10ef4f0392a9f4eec0843943', 'request_id': 'req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.748584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] The token cache is being invalidate because project 266cfb5a10ef4f0392a9f4eec0843943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:47.749432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.751912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16f59bac-92cb-4fd6-9f2d-6d8a9df510e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:47.754303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 857/1732] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:47 2022] DELETE /identity/v3/projects/266cfb5a10ef4f0392a9f4eec0843943 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:47.761022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998a78-0c7c-47d7-87f5-e7dc6bc4ddaa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:47.764353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998a78-0c7c-47d7-87f5-e7dc6bc4ddaa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:47.766211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998a78-0c7c-47d7-87f5-e7dc6bc4ddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:47.829392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-88998a78-0c7c-47d7-87f5-e7dc6bc4ddaa None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:47.833799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-88998a78-0c7c-47d7-87f5-e7dc6bc4ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:48.051604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 876/1733] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:48.061791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05087e5-ef70-48b8-a5b5-0914c94bfb90 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.066302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05087e5-ef70-48b8-a5b5-0914c94bfb90 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.066786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05087e5-ef70-48b8-a5b5-0914c94bfb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.095324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a05087e5-ef70-48b8-a5b5-0914c94bfb90 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:48.098289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a05087e5-ef70-48b8-a5b5-0914c94bfb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:48.111430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 858/1734] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:10:48.116031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998a78-0c7c-47d7-87f5-e7dc6bc4ddaa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.129335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998a78-0c7c-47d7-87f5-e7dc6bc4ddaa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.145091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.145883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.146167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.146443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.151810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:48.152172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.154059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.197481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 877/1735] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:48.203464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05087e5-ef70-48b8-a5b5-0914c94bfb90 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.215687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05087e5-ef70-48b8-a5b5-0914c94bfb90 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.233126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.235372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.235842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.236985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.237802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.244413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.323382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 859/1736] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:48 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:48.327912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.340318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e121461-31e3-49ad-9425-f11a2923e298 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.499987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.500643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.500924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.501199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.501845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.503876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.566487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 878/1737] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:48 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:48.573336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.589913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.604419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005541-4ad2-4975-9fc6-40cba3e016c3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.608109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:48.627339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.635709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.636410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.638584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.640154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.659401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.683570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1edd3-8174-47b5-a60e-aa9a219ec92b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.712203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.712897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.713167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.713433 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] PATH_INFO: `/v3/projects/371a416a73eb439dba0975651687cac1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.717044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 860/1738] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:10:48.721076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.722112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371a416a73eb439dba0975651687cac1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.724118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.737112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:48.764864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4fb9-963b-4eb2-8a26-5ffea1907fc5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.777235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:48.780070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.780387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.780663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:48.782785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:48.788526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:48.815285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 861/1739] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:48.817755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:48.831324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:48.840730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faaa4b-c1a5-49be-9618-eefb292af2a4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:48.867333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371a416a73eb439dba0975651687cac1', 'request_id': 'req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.894981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371a416a73eb439dba0975651687cac1', 'request_id': 'req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.930620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371a416a73eb439dba0975651687cac1', 'request_id': 'req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.968881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] The token cache is being invalidate because project 371a416a73eb439dba0975651687cac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:48.969217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.971336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aceb7c89-93cd-4c9a-aa9b-9f8d1e8524f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:48.978223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 879/1740] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:48 2022] DELETE /identity/v3/projects/371a416a73eb439dba0975651687cac1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:48.985156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8cc19-bc68-458e-a642-a545e57587af None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:48.985543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8cc19-bc68-458e-a642-a545e57587af None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:48.985818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8cc19-bc68-458e-a642-a545e57587af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.104979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-22b8cc19-bc68-458e-a642-a545e57587af None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.109775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-22b8cc19-bc68-458e-a642-a545e57587af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.110903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71863750-65b1-4d58-8eba-ade1780874e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.111725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71863750-65b1-4d58-8eba-ade1780874e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.113319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71863750-65b1-4d58-8eba-ade1780874e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.113617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71863750-65b1-4d58-8eba-ade1780874e9 admin admin] PATH_INFO: `/v3/projects/4ee88cea2b7f49a9a75dc4a7bbab08bb/users/1d8ce19b4ebd4a69b9eb3b3778328cb4/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.154536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 880/1741] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:49.154536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62913da0-727a-4b54-9406-e5f15ec1bb02 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.154536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62913da0-727a-4b54-9406-e5f15ec1bb02 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.154536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62913da0-727a-4b54-9406-e5f15ec1bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.166367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71863750-65b1-4d58-8eba-ade1780874e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee88cea2b7f49a9a75dc4a7bbab08bb, user_id=1d8ce19b4ebd4a69b9eb3b3778328cb4, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.177283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71863750-65b1-4d58-8eba-ade1780874e9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.233197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 862/1742] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:48 2022] PUT /identity/v3/projects/4ee88cea2b7f49a9a75dc4a7bbab08bb/users/1d8ce19b4ebd4a69b9eb3b3778328cb4/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:49.261250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-62913da0-727a-4b54-9406-e5f15ec1bb02 None None] MFA Rules not processed for user `7e2d039823e64703a62623adb8eb0261`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.262505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-62913da0-727a-4b54-9406-e5f15ec1bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.270468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.270956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.271390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.345478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.349056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.472088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 881/1743] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:49.473608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2598-76ed-4aef-ab57-d1cc096d2a9c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.473895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2598-76ed-4aef-ab57-d1cc096d2a9c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.474170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2598-76ed-4aef-ab57-d1cc096d2a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.531518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5ebc2598-76ed-4aef-ab57-d1cc096d2a9c None None] MFA Rules not processed for user `1d8ce19b4ebd4a69b9eb3b3778328cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.533754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5ebc2598-76ed-4aef-ab57-d1cc096d2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.602781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 863/1744] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:49.607932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.615909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.665093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c51df-2ec8-4772-9d23-60c924467368 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.686232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 882/1745] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:49.687627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9affc-0971-43a5-9ad1-dc0c67f0ad95 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.688173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9affc-0971-43a5-9ad1-dc0c67f0ad95 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.688503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9affc-0971-43a5-9ad1-dc0c67f0ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.693741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.695765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.697798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.698123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] PATH_INFO: `/v3/projects/af3aa24ea9d84fb48e734c8f1d81b919` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.700443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3aa24ea9d84fb48e734c8f1d81b919)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.706902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.718450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f3a9affc-0971-43a5-9ad1-dc0c67f0ad95 None None] MFA Rules not processed for user `7e2d039823e64703a62623adb8eb0261`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:49.720697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f3a9affc-0971-43a5-9ad1-dc0c67f0ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.734704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 883/1746] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:49.734704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9affc-0971-43a5-9ad1-dc0c67f0ad95 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.744419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9affc-0971-43a5-9ad1-dc0c67f0ad95 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.752349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:49.755178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:49.755570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:49.756007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:49.757379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:49.757741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:49.762185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:49.810479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 884/1747] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:49.810479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.814527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:49.829352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3aa24ea9d84fb48e734c8f1d81b919', 'request_id': 'req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.843292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3aa24ea9d84fb48e734c8f1d81b919', 'request_id': 'req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.852024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3aa24ea9d84fb48e734c8f1d81b919', 'request_id': 'req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.857835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdbc9f-2d5e-4d43-b45b-ab5c0727d6a0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:49.865868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:49.880572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:49.890665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] The token cache is being invalidate because project af3aa24ea9d84fb48e734c8f1d81b919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:49.890905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.895755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:49.903051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 864/1748] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:49 2022] DELETE /identity/v3/projects/af3aa24ea9d84fb48e734c8f1d81b919 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:49.903051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:49.903051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.073061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.077990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.079783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.081598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.082558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.094337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.117288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007ba3-b139-49f5-9e82-eef5dacaf3d7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.136146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.136762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.137065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.137344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.144275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.171046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 885/1749] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:49 2022] POST /identity/v3/projects => generated 365 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:50.171046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.172989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.239482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.241244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.259880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 865/1750] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:50.260864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.264512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.299593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e8df3-0a3c-4c48-9d6f-4c3a666e7da9 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.352792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486dae-4b59-46fe-af14-3109c7064505 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.364014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.366268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.366520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.367032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] PATH_INFO: `/v3/projects/e33d0106a2304010a3aacdf0199457fc` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.375809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33d0106a2304010a3aacdf0199457fc)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.381561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.455594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.456235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.456518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.456793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.457437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.459363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.531202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 866/1751] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:50.535569 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:50.540906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.546084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33d0106a2304010a3aacdf0199457fc', 'request_id': 'req-b5bd7075-30cb-4623-8558-2f0a1b998a22'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.569142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33d0106a2304010a3aacdf0199457fc', 'request_id': 'req-b5bd7075-30cb-4623-8558-2f0a1b998a22'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.588067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33d0106a2304010a3aacdf0199457fc', 'request_id': 'req-b5bd7075-30cb-4623-8558-2f0a1b998a22'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.588819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:50.608890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] The token cache is being invalidate because project e33d0106a2304010a3aacdf0199457fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:50.609341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.610151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5bd7075-30cb-4623-8558-2f0a1b998a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.612437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 886/1752] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:50 2022] DELETE /identity/v3/projects/e33d0106a2304010a3aacdf0199457fc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:50.613994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6023d-90c5-4dff-8365-0a425ee662ab None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.614380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6023d-90c5-4dff-8365-0a425ee662ab None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.615839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6023d-90c5-4dff-8365-0a425ee662ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.693745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7fc6023d-90c5-4dff-8365-0a425ee662ab None None] MFA Rules not processed for user `b531d7ca59814d359b30264d2c9f7116`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:50.695407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7fc6023d-90c5-4dff-8365-0a425ee662ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:50.705498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c06c3-ee6e-4bda-aac1-955f50c325a2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:50.726882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:50.727719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.728070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.728418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] PATH_INFO: `/v3/users/0cf0a38770e54c6094f76107d3f65767` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.729307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:50.731353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf0a38770e54c6094f76107d3f65767)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:50.736051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:50.884891 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 887/1753] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:50.885817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf0a38770e54c6094f76107d3f65767'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.893306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58bdf-b912-445a-8f95-b0182a778635 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:50.893734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58bdf-b912-445a-8f95-b0182a778635 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:50.894114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58bdf-b912-445a-8f95-b0182a778635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:50.941837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf0a38770e54c6094f76107d3f65767'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.961438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf0a38770e54c6094f76107d3f65767'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.962983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf0a38770e54c6094f76107d3f65767'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:50.964357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf0a38770e54c6094f76107d3f65767'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:51.003934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 867/1754] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:50 2022] DELETE /identity/v3/users/0cf0a38770e54c6094f76107d3f65767 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:51.004949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.008186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.029284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1fb58bdf-b912-445a-8f95-b0182a778635 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:51.035991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1fb58bdf-b912-445a-8f95-b0182a778635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.200242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbb628-b259-4346-a89c-a209b176afb9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.219207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.220269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.220720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.221152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.222397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.239560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.290682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 868/1755] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:51.299969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.308941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.319080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 888/1756] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:51.320923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af05633-cde3-46d6-87f8-e4979b040924 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.320923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af05633-cde3-46d6-87f8-e4979b040924 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.321169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af05633-cde3-46d6-87f8-e4979b040924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.383824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763962f-667b-473b-ae53-126c3c5e008f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.402202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.403133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.403745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.404236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.404681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0af05633-cde3-46d6-87f8-e4979b040924 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:51.405102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.407922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.410491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0af05633-cde3-46d6-87f8-e4979b040924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.442527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 889/1757] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:51.443915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af05633-cde3-46d6-87f8-e4979b040924 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.462204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 869/1758] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:51.463748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af05633-cde3-46d6-87f8-e4979b040924 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.465645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.476442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.482669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d367-7001-418b-b787-f5077b60b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.492624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d367-7001-418b-b787-f5077b60b992 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.492913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d367-7001-418b-b787-f5077b60b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.493189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d367-7001-418b-b787-f5077b60b992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.495535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d367-7001-418b-b787-f5077b60b992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.504408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d367-7001-418b-b787-f5077b60b992 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.524102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 890/1759] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:51.525467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8d7ec-2937-437f-95fa-33ee87645883 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.525756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8d7ec-2937-437f-95fa-33ee87645883 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.526036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8d7ec-2937-437f-95fa-33ee87645883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.556381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:51.569020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-94d8d7ec-2937-437f-95fa-33ee87645883 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:51.570467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-94d8d7ec-2937-437f-95fa-33ee87645883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:51.601645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 891/1760] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:51.607757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8d7ec-2937-437f-95fa-33ee87645883 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.636256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8d7ec-2937-437f-95fa-33ee87645883 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.657752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.658392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.658677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.658939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.659620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.661237 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.699276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 892/1761] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:51.700875 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.740703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71b2f9-f2c6-476b-9494-315afd3ea2a0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:51.759356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:51.760340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:51.760781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:51.767123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] PATH_INFO: `/v3/projects/244dafe6c40346d7a5718985c0634f4e/users/d3b22c03c1a046058d125fc5cf9c501b/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:51.833058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244dafe6c40346d7a5718985c0634f4e, user_id=d3b22c03c1a046058d125fc5cf9c501b, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:51.841299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:51.897902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 893/1762] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:51 2022] PUT /identity/v3/projects/244dafe6c40346d7a5718985c0634f4e/users/d3b22c03c1a046058d125fc5cf9c501b/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:51.906065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:51.928763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ca28-3c08-433a-bb08-5db7049b6cd9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.104711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.209850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da35ee-577f-4d49-8eae-62792e2aabf2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.228964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.233403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.234892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.235695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.236132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.236567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.236992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.238157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:52.238384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.239974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.242203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.243348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.274516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 894/1763] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:52.283986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.296043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:52.445627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.456446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.530568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 870/1764] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1068 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:52.532041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.569978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49ebe-9283-4524-b3bf-b0ead0f912c1 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.584408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.586337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.586610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.588519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.589812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.595205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.629288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 871/1765] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:52.630263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.659182 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b547eac-39f5-4216-be0f-95117feca75f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.673694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.677952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.678261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.678532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.679222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.680897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.691110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1b50c-9790-47eb-8e5c-ac85202b8b62 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.708925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.709717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.710109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.710501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.716777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 872/1766] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:52.718039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.744382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34566c-5766-4daf-b90f-611d5ba2f512 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:52.756737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:52.757370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:52.757656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:52.757932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:52.763298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.769469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.835155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:52.837033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:52.848057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 873/1767] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:52 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:52.854616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.858377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 895/1768] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:10:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:10:52.860031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:52.878872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:52.901145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4ca0e-8109-4465-91a4-d3a5b16e124a service swift] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:53.110181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:53.176419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:53.178533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:53.181937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:53.183212 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] PATH_INFO: `/v3/projects/244dafe6c40346d7a5718985c0634f4e/users/d3b22c03c1a046058d125fc5cf9c501b/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:53.187571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244dafe6c40346d7a5718985c0634f4e, user_id=d3b22c03c1a046058d125fc5cf9c501b, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:53.196821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:53.212409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b3b7a-9a5d-4261-a263-56e7d6f18151 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:53.237796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 896/1769] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:52 2022] PUT /identity/v3/projects/244dafe6c40346d7a5718985c0634f4e/users/d3b22c03c1a046058d125fc5cf9c501b/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:53.239013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:53.456014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58979d95-504c-49e8-8157-470d057aa220 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:53.467607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:53.469546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:53.471050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:53.471694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] PATH_INFO: `/v3/projects/da0ed3e905604c2ca005d3f33ce03b98/users/9dd3417c5a1843bab2d56e3b7c414209/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:53.474818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c0619-314b-481a-9ce9-b6f5024c2df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:53.475754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c0619-314b-481a-9ce9-b6f5024c2df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:53.476062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c0619-314b-481a-9ce9-b6f5024c2df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:53.476339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c0619-314b-481a-9ce9-b6f5024c2df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:53.491784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c0619-314b-481a-9ce9-b6f5024c2df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:53.495633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c0619-314b-481a-9ce9-b6f5024c2df3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:53.552023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0ed3e905604c2ca005d3f33ce03b98, user_id=9dd3417c5a1843bab2d56e3b7c414209, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:53.552229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 897/1770] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:53 2022] POST /identity/v3/users => generated 286 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:53.554445 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a0e82-d0a9-4c11-b583-bf3473386f43 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:53.555798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a0e82-d0a9-4c11-b583-bf3473386f43 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:53.556102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a0e82-d0a9-4c11-b583-bf3473386f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:53.571181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:53.651728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-446a0e82-d0a9-4c11-b583-bf3473386f43 None None] MFA Rules not processed for user `d3b22c03c1a046058d125fc5cf9c501b`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:53.653349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-446a0e82-d0a9-4c11-b583-bf3473386f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:53.656757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 874/1771] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:52 2022] PUT /identity/v3/projects/da0ed3e905604c2ca005d3f33ce03b98/users/9dd3417c5a1843bab2d56e3b7c414209/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:53.658707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:53.879365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c1a8-c147-408b-903d-9a7dfac63456 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:53.903173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:53.911876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:53.912207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:53.913521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:53.914226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:53.923005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:53.945678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 898/1772] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:53.947211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66d77-f178-45c7-acfc-91dbeda4ede0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:53.947522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66d77-f178-45c7-acfc-91dbeda4ede0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:53.947796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66d77-f178-45c7-acfc-91dbeda4ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:53.976535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 875/1773] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:53.980620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:53.984273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.085998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cca66d77-f178-45c7-acfc-91dbeda4ede0 None None] MFA Rules not processed for user `9dd3417c5a1843bab2d56e3b7c414209`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:54.092829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cca66d77-f178-45c7-acfc-91dbeda4ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.120296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:54.228564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27244b-e3e6-4768-8505-29bc81a07271 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.239513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.240159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.240449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.240749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.269130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.273382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.313629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 876/1774] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:54.314010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:54.316181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.360678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab278-04c1-4aaf-bc20-12fe39668603 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.391006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 899/1775] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:54.393973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.395645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca66d77-f178-45c7-acfc-91dbeda4ede0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.396789 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.397080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.397872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.398271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.420705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca66d77-f178-45c7-acfc-91dbeda4ede0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.427154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.427347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.427948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.428227 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.445854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.447833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.451360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.496301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 877/1776] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:54.497514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.501722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.524391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 900/1777] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:54 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:54.525556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.536039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fbc93-b7c2-43cd-876e-d96a2fff6380 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.683898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.685629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.686076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.686577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.691931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:54.820502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78e53-6543-4d0d-bf19-6c4e3df9d691 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.829487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ee40-84a3-4c18-976c-89c4f37cedc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:54.845079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ee40-84a3-4c18-976c-89c4f37cedc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:54.845693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ee40-84a3-4c18-976c-89c4f37cedc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:54.848056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ee40-84a3-4c18-976c-89c4f37cedc7 admin admin] PATH_INFO: `/v3/projects/440fc77abd9246a88d453354ed9eea21/users/dd4e641f5ad64753843a0ba3e2367ab6/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:54.872818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.879476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.944066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109ee40-84a3-4c18-976c-89c4f37cedc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440fc77abd9246a88d453354ed9eea21, user_id=dd4e641f5ad64753843a0ba3e2367ab6, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:54.950245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 878/1778] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:54.951438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:54.957183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109ee40-84a3-4c18-976c-89c4f37cedc7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:54.995509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96462f-fd44-49e3-b9d4-1d60130a6930 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:54.996014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 901/1779] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:54 2022] PUT /identity/v3/projects/440fc77abd9246a88d453354ed9eea21/users/dd4e641f5ad64753843a0ba3e2367ab6/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:55.009214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.009541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.009814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.134431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] MFA Rules not processed for user `dd4e641f5ad64753843a0ba3e2367ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:55.142959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:55.234119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.234805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.235082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.236230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.237011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.247180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:55.314856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 879/1780] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:54 2022] POST /identity/v3/users => generated 299 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:55.319882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:55.356037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:55.365384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12e7b-aca6-4c9d-8d1f-c2db536db860 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:55.385046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.385607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.385882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.386149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.386812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.389067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:55.433053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 880/1781] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:55.438556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:55.460236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830baea0-5945-4112-9118-87624a7ad08a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:55.478626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.479761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.483449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.483449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] PATH_INFO: `/v3/projects/ca832d8a08744e8ba3b0c74f4a4dfe37/users/4c200db8106d4195a98758b86361895d/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.533514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca832d8a08744e8ba3b0c74f4a4dfe37, user_id=4c200db8106d4195a98758b86361895d, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.533514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:55.542561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 902/1782] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:55.557812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:55.584194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:55.606508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 881/1783] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:55 2022] PUT /identity/v3/projects/ca832d8a08744e8ba3b0c74f4a4dfe37/users/4c200db8106d4195a98758b86361895d/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:55.608287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:55.616741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72fb8a-5067-41dd-af01-43534b24e6b5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:55.693089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:55.762424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceedd9-5a32-4e40-b332-c7535c33c97f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:55.780424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.781500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.781933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.782597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.784375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:55.785041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:55.785325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:55.785657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] PATH_INFO: `/v3/projects/52a2ed87b3f247d2ac74311c26e38fad` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:55.796151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a2ed87b3f247d2ac74311c26e38fad)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:55.799219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.055381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a2ed87b3f247d2ac74311c26e38fad', 'request_id': 'req-158b4e2c-a22f-43af-acf6-5952a0cf96f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.078752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.080509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a2ed87b3f247d2ac74311c26e38fad', 'request_id': 'req-158b4e2c-a22f-43af-acf6-5952a0cf96f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.082733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.109495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a2ed87b3f247d2ac74311c26e38fad', 'request_id': 'req-158b4e2c-a22f-43af-acf6-5952a0cf96f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.142549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 882/1784] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:56.143907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.159460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] The token cache is being invalidate because project 52a2ed87b3f247d2ac74311c26e38fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:56.159781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.161388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.165875 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 903/1785] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:55 2022] DELETE /identity/v3/projects/52a2ed87b3f247d2ac74311c26e38fad => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:56.166799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.172770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.175432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c02547-cfd2-4187-a1b0-567290fb72df service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.353089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1663c3-8bbd-4ca1-9190-260837e36ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.353738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1663c3-8bbd-4ca1-9190-260837e36ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.354041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1663c3-8bbd-4ca1-9190-260837e36ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.354317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1663c3-8bbd-4ca1-9190-260837e36ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.355016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1663c3-8bbd-4ca1-9190-260837e36ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.359555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b4e2c-a22f-43af-acf6-5952a0cf96f2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.360737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1663c3-8bbd-4ca1-9190-260837e36ff3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.373922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.374589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.374870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.375144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] PATH_INFO: `/v3/users/dd4e641f5ad64753843a0ba3e2367ab6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.376832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4e641f5ad64753843a0ba3e2367ab6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.382839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.386333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 883/1786] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:56.389000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.389297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.389582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.458449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.460811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.489645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 884/1787] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:56.492328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:56.498971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.512001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4e641f5ad64753843a0ba3e2367ab6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.514174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4e641f5ad64753843a0ba3e2367ab6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.523802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0628-f3f9-4284-b520-4ce160ab0358 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:56.542896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:56.544954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b6e4-a42e-44aa-90b6-648217b783d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:56.545733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b6e4-a42e-44aa-90b6-648217b783d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.546017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b6e4-a42e-44aa-90b6-648217b783d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.546828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b6e4-a42e-44aa-90b6-648217b783d9 admin admin] PATH_INFO: `/v3/projects/ca832d8a08744e8ba3b0c74f4a4dfe37/users/4c200db8106d4195a98758b86361895d/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.548461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4e641f5ad64753843a0ba3e2367ab6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.550028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4e641f5ad64753843a0ba3e2367ab6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.552876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850b6e4-a42e-44aa-90b6-648217b783d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca832d8a08744e8ba3b0c74f4a4dfe37, user_id=4c200db8106d4195a98758b86361895d, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:56.558544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850b6e4-a42e-44aa-90b6-648217b783d9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:56.579708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a706581a-9abd-44a0-9e0f-ec35230fc172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4e641f5ad64753843a0ba3e2367ab6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:56.592398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:56.609591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 885/1788] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:56 2022] PUT /identity/v3/projects/ca832d8a08744e8ba3b0c74f4a4dfe37/users/4c200db8106d4195a98758b86361895d/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:56.611009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f9811-8e6b-4704-960f-5c7681615a76 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.617512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 904/1789] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:56 2022] DELETE /identity/v3/users/dd4e641f5ad64753843a0ba3e2367ab6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:56.619083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d892-9ae7-446a-998e-93b17120906d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.619368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d892-9ae7-446a-998e-93b17120906d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.619799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f9811-8e6b-4704-960f-5c7681615a76 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.620088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f9811-8e6b-4704-960f-5c7681615a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.622362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d892-9ae7-446a-998e-93b17120906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.676772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-be65d892-9ae7-446a-998e-93b17120906d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.678165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-be65d892-9ae7-446a-998e-93b17120906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.679670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b98f9811-8e6b-4704-960f-5c7681615a76 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.680967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b98f9811-8e6b-4704-960f-5c7681615a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.853030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 886/1790] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:56.853704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 905/1791] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:56.857731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.858089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.858443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.860478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cd7de-8416-4eb8-8b41-79bedc453212 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:56.860744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cd7de-8416-4eb8-8b41-79bedc453212 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:56.861034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cd7de-8416-4eb8-8b41-79bedc453212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:56.963761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c85cd7de-8416-4eb8-8b41-79bedc453212 None None] MFA Rules not processed for user `4cd431767adb4fbe8d17de4c56915d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.965059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c85cd7de-8416-4eb8-8b41-79bedc453212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:56.996251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] MFA Rules not processed for user `4c200db8106d4195a98758b86361895d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:56.998076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.213406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 906/1792] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:57.217857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cd7de-8416-4eb8-8b41-79bedc453212 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.258809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 887/1793] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:57.259747 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.269664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.297317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cd7de-8416-4eb8-8b41-79bedc453212 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.319363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.340709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.340709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.340709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.340709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:10:57.340709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.340709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.415528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 907/1794] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:10:57.441291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.454900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.479851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212e8c-e139-41fe-809c-15244d6d12e3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.493304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.501674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.501963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.502342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.530168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.531711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.583743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 888/1795] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:57.597860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.636774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcaa6c-d57d-4521-8c6c-885032952bb6 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.665873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a992739-0a67-4188-bd90-0e93e23f895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.666576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a992739-0a67-4188-bd90-0e93e23f895c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.666859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a992739-0a67-4188-bd90-0e93e23f895c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.667136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a992739-0a67-4188-bd90-0e93e23f895c admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.667807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a992739-0a67-4188-bd90-0e93e23f895c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.672462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a992739-0a67-4188-bd90-0e93e23f895c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.721415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aad20a-d0f5-4e1e-8f86-878336033c4a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:57.735349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:57.738736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.739944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.741532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.755722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 889/1796] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:57.759265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ba719-6e4b-4310-99c1-c1bb1b7f6adc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:57.759921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ba719-6e4b-4310-99c1-c1bb1b7f6adc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:57.759921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ba719-6e4b-4310-99c1-c1bb1b7f6adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:57.782816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:57.783829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:57.791731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:57.798931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b77ba719-6e4b-4310-99c1-c1bb1b7f6adc None None] MFA Rules not processed for user `465160a7e1c24601b83be37681ef322d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:57.800328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b77ba719-6e4b-4310-99c1-c1bb1b7f6adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:57.856587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 908/1797] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:57.861351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:57.925472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e22fe-c6f7-41d9-8de8-d33b2878b871 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.000426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:58.002008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 890/1798] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:58.147752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ba719-6e4b-4310-99c1-c1bb1b7f6adc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.165051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ba719-6e4b-4310-99c1-c1bb1b7f6adc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.180423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.181823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.186689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.187030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.222245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.224189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.230151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.232005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.232398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.232786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.235450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.241162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.249017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 891/1799] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:58.250144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.269827 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857707bc-0b8b-43d9-93a5-720750f7cc15 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.289643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.304007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.305201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.309249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.314512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 909/1800] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:57 2022] POST /identity/v3/users => generated 290 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:58.319456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.339966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.347722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.353672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c51c2-3c08-4284-9d44-6f9b28fb6fc0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.376198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.376988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.377277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.377636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.378209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.388694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 892/1801] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:10:58.392814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.426976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.434343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 910/1802] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:58.448936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe476ee2-50f4-4b09-a7ee-15d48333afee service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.477932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a7558-ee10-4367-aafa-0ff2f7e02738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.481978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7558-ee10-4367-aafa-0ff2f7e02738 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.483307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7558-ee10-4367-aafa-0ff2f7e02738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.485198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7558-ee10-4367-aafa-0ff2f7e02738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.486079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a7558-ee10-4367-aafa-0ff2f7e02738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.496312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a7558-ee10-4367-aafa-0ff2f7e02738 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.534321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:58.534532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 893/1803] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:10:58.551029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29e430-324a-40aa-98ec-56c84ae9af1b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:58.568442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:58.569733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.570208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.570656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] PATH_INFO: `/v3/projects/12c0d8dc03df40ce9dd937fa26eae619/users/31be3c6a49444ec7bc297d18ddd4c2b4/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.703794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c0d8dc03df40ce9dd937fa26eae619, user_id=31be3c6a49444ec7bc297d18ddd4c2b4, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:58.736959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:58.791447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 911/1804] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:10:58 2022] PUT /identity/v3/projects/12c0d8dc03df40ce9dd937fa26eae619/users/31be3c6a49444ec7bc297d18ddd4c2b4/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:10:58.803072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:58.803670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:58.803670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:58.855224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] MFA Rules not processed for user `31be3c6a49444ec7bc297d18ddd4c2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:10:58.859120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:59.197161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.197762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 894/1805] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:10:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:10:59.511615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ec92a-6051-4db4-934d-3e78bb6bda0c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:59.524144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:59.525005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:59.525425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:59.525840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:59.527319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:59.536327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:59.566527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.568002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:10:59.601955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e76-fcda-44e1-abc0-c76819d05c5a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:59.616426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:10:59.617088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:10:59.617362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:10:59.618065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] PATH_INFO: `/v3/projects/440fc77abd9246a88d453354ed9eea21` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:10:59.621678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 912/1806] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:10:59 2022] POST /identity/v3/projects => generated 379 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:10:59.627491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.627841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440fc77abd9246a88d453354ed9eea21)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:10:59.633671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:10:59.798752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440fc77abd9246a88d453354ed9eea21', 'request_id': 'req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.813735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:59.823851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440fc77abd9246a88d453354ed9eea21', 'request_id': 'req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.832883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11e7e-caca-45f4-8743-22d78e189a9c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:10:59.849338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:10:59.859125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440fc77abd9246a88d453354ed9eea21', 'request_id': 'req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.907122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] The token cache is being invalidate because project 440fc77abd9246a88d453354ed9eea21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:10:59.907347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.912454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:10:59.922598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 895/1807] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:10:59 2022] DELETE /identity/v3/projects/440fc77abd9246a88d453354ed9eea21 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:10:59.923621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:10:59.930810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.082810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea8f79-c1a0-402f-bfb1-5e431d0d5e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.083476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea8f79-c1a0-402f-bfb1-5e431d0d5e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.083761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea8f79-c1a0-402f-bfb1-5e431d0d5e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.084033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea8f79-c1a0-402f-bfb1-5e431d0d5e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.085310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea8f79-c1a0-402f-bfb1-5e431d0d5e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.087459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea8f79-c1a0-402f-bfb1-5e431d0d5e92 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.171182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 913/1808] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:10:59 2022] POST /identity/v3/users => generated 290 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:00.171182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.174320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.174650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.186932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a819-62f4-4bb5-9d5f-753aacf5ccd6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:00.209294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.209294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.209294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.209294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] PATH_INFO: `/v3/users/9dd3417c5a1843bab2d56e3b7c414209` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.213174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd3417c5a1843bab2d56e3b7c414209)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.230935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.249960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:00.256382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.283616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 914/1809] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:00.286402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:00.291569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.323050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e57987-4006-43a1-8248-66b828b2c9f7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:00.328970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99506b21-0017-4f2a-93d9-256cf46f64de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.329652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506b21-0017-4f2a-93d9-256cf46f64de admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.329934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506b21-0017-4f2a-93d9-256cf46f64de admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.330211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506b21-0017-4f2a-93d9-256cf46f64de admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.330998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99506b21-0017-4f2a-93d9-256cf46f64de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.332742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99506b21-0017-4f2a-93d9-256cf46f64de admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.353325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 915/1810] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:00.359213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.359589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.359918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.370423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd3417c5a1843bab2d56e3b7c414209'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.421886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:00.424481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd3417c5a1843bab2d56e3b7c414209'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.427299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.443767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd3417c5a1843bab2d56e3b7c414209'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.445749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd3417c5a1843bab2d56e3b7c414209'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.446964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd3417c5a1843bab2d56e3b7c414209'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:00.466364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 916/1811] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:00.468628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:00.471191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:00.504276 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 896/1812] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:10:59 2022] DELETE /identity/v3/users/9dd3417c5a1843bab2d56e3b7c414209 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:00.505537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:00.536069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79f4c7-1980-46a7-bc07-2bad83dcb5ce None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:00.877457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c24be-6d47-44b1-96d4-cdd22525c0a4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:00.894385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.896229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.896510 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.896880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.905180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f30157-c0dd-46f9-8100-1a10bef32b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:00.906177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30157-c0dd-46f9-8100-1a10bef32b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.907264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30157-c0dd-46f9-8100-1a10bef32b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.909407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30157-c0dd-46f9-8100-1a10bef32b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.910636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30157-c0dd-46f9-8100-1a10bef32b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:00.912998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30157-c0dd-46f9-8100-1a10bef32b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.918613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:00.921245 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.922144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30157-c0dd-46f9-8100-1a10bef32b25 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:00.955699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 897/1813] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:00.958368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787b9b-99e1-40b8-be6d-5985c088fa0c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:00.958368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787b9b-99e1-40b8-be6d-5985c088fa0c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:00.958368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787b9b-99e1-40b8-be6d-5985c088fa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:00.974804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 917/1814] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:00.983555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:00.993521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:01.015926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4598f-ad7d-409e-a3c6-94bd45213c4e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.037836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.038657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.039061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.039260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.040261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.041340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6d787b9b-99e1-40b8-be6d-5985c088fa0c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:01.043082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6d787b9b-99e1-40b8-be6d-5985c088fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.056603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.074912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 898/1815] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:01.078851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787b9b-99e1-40b8-be6d-5985c088fa0c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.097321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787b9b-99e1-40b8-be6d-5985c088fa0c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.119241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.120126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.120435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.120788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] PATH_INFO: `/v3/projects/76367300d7704bf2b1a1280aa23ece16/users/dde8201fb9c948228a73272d50787965/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.123320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 918/1816] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:00 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:01.126284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.140875 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.146751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=76367300d7704bf2b1a1280aa23ece16, user_id=dde8201fb9c948228a73272d50787965, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.150775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.190990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 899/1817] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:01 2022] PUT /identity/v3/projects/76367300d7704bf2b1a1280aa23ece16/users/dde8201fb9c948228a73272d50787965/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:01.190990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.274311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:01.335944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a5fb0-cb1c-483f-a481-ff427fd6865c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.406320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7e50-06d6-4a45-8448-669f13c770cc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.430454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.431079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.431361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.435179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.441082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.450862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.508627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.509295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.509576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.509852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] PATH_INFO: `/v3/users/1d8ce19b4ebd4a69b9eb3b3778328cb4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.511523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8ce19b4ebd4a69b9eb3b3778328cb4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:01.516869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:01.554239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 900/1818] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:01 2022] POST /identity/v3/users => generated 288 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:01.554239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:01.560593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.630897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8ce19b4ebd4a69b9eb3b3778328cb4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.631744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8ce19b4ebd4a69b9eb3b3778328cb4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.680120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8ce19b4ebd4a69b9eb3b3778328cb4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.693873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8ce19b4ebd4a69b9eb3b3778328cb4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.725152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-978cd9a4-b79e-4f3b-b260-0840de229eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8ce19b4ebd4a69b9eb3b3778328cb4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:01.762845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 919/1819] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:01 2022] DELETE /identity/v3/users/1d8ce19b4ebd4a69b9eb3b3778328cb4 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:01.766121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902a76-2cd9-449e-b671-10af7f056940 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:01.767503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.768089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.769417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.851607 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] MFA Rules not processed for user `dde8201fb9c948228a73272d50787965`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:01.852883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:01.923453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be06844-32d9-49d5-bba1-2d0b2c206fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:01.924251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06844-32d9-49d5-bba1-2d0b2c206fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:01.924584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06844-32d9-49d5-bba1-2d0b2c206fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:01.924685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06844-32d9-49d5-bba1-2d0b2c206fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:01.929114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8be06844-32d9-49d5-bba1-2d0b2c206fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:02.003377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:02.071659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:02.100305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 920/1820] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:02.101395 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.104554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:02.122031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06844-32d9-49d5-bba1-2d0b2c206fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.126586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06844-32d9-49d5-bba1-2d0b2c206fd5 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.128772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08401808-64cb-4b30-8524-ca6dbda1466e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.134746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.135619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.135903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.136183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.137100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.142890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.155077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 901/1821] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:02.156809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d9d4-c787-4e23-99a4-4ecdf17b61f7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.161623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d9d4-c787-4e23-99a4-4ecdf17b61f7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.162141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d9d4-c787-4e23-99a4-4ecdf17b61f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.167604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 921/1822] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:02.167604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.169845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:02.204289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67bd32-26a9-47fd-8fb8-196f3cc85ac1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.209878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.210676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.211330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.211501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.212627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.215105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.219730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a623d9d4-c787-4e23-99a4-4ecdf17b61f7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:02.222122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a623d9d4-c787-4e23-99a4-4ecdf17b61f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:02.250907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 902/1823] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:02.250907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d9d4-c787-4e23-99a4-4ecdf17b61f7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.266068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 922/1824] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:02 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:02.272165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.301304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d9d4-c787-4e23-99a4-4ecdf17b61f7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.455921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.462272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.464900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.466372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.469064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.480471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.541291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 903/1825] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:02.542278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.548431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:02.552266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d1e94-0836-48fd-aa40-a1257f30f027 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.562504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.563622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.564071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.564496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.565361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.568182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.625439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 923/1826] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:02 2022] POST /identity/v3/users => generated 296 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:02.626601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.671613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6c408-80f0-447a-9185-511f403161a5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.690866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.692296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.695021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.697160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] PATH_INFO: `/v3/projects/526df9f9bff747988e4c2ab83b65786a/users/88653e434dea4cce8dc3dcac864931b0/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.728860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8c956-71c7-4d2c-85ca-22a4f58f6f15 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:02.745734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e7d52-16f7-4170-9933-f7b4482560da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:02.752164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7d52-16f7-4170-9933-f7b4482560da service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.755060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7d52-16f7-4170-9933-f7b4482560da service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.757886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7d52-16f7-4170-9933-f7b4482560da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.760163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] RBAC: Authorizing `identity:create_grant(project_id=526df9f9bff747988e4c2ab83b65786a, user_id=88653e434dea4cce8dc3dcac864931b0, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.773262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.801166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e7d52-16f7-4170-9933-f7b4482560da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:02.806288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e7d52-16f7-4170-9933-f7b4482560da service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:02.829054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 924/1827] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:02 2022] PUT /identity/v3/projects/526df9f9bff747988e4c2ab83b65786a/users/88653e434dea4cce8dc3dcac864931b0/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:02.843911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:02.858191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 904/1828] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:02.860825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd3d0-d2c4-4178-9d95-5e109ba347e9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:02.861445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd3d0-d2c4-4178-9d95-5e109ba347e9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:02.862021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd3d0-d2c4-4178-9d95-5e109ba347e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:02.960727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-09cfd3d0-d2c4-4178-9d95-5e109ba347e9 None None] MFA Rules not processed for user `88653e434dea4cce8dc3dcac864931b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:02.962895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-09cfd3d0-d2c4-4178-9d95-5e109ba347e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:03.081812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d539804-d068-4fee-ad53-0f2e33db368b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.099511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.101288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.105648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.106082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.113467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.123605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.128036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:03.193790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 925/1829] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:03.198785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 905/1830] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:03.201490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.204646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd3d0-d2c4-4178-9d95-5e109ba347e9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.267941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742bb36-0078-42d2-8ffd-d01a43aab7c8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.286835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd3d0-d2c4-4178-9d95-5e109ba347e9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.305918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.306706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.306915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.307191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] PATH_INFO: `/v3/projects/622ceb0b8bc14e599b8f0ac3074c0c3e/users/1b7afd1f7b0a4c16ad1aaae6f68e9391/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.309829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.310481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.310763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.311038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.311707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.313924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.368384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=622ceb0b8bc14e599b8f0ac3074c0c3e, user_id=1b7afd1f7b0a4c16ad1aaae6f68e9391, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.379336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.418207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 926/1831] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:03 2022] PUT /identity/v3/projects/622ceb0b8bc14e599b8f0ac3074c0c3e/users/1b7afd1f7b0a4c16ad1aaae6f68e9391/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:03.425830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.426449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 906/1832] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:03 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:03.430662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.438246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:03.537911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec15c10-da4a-4fa4-864d-097aa00ecd11 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.544280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.545154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.545436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.545705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.546337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.551702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.556360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5b66-36f6-4dd6-913e-7ae16d07d5aa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.563905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.564725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.565288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.565718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.566525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.569280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.595341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 927/1833] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:03.596606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.626135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fc01b-31cb-4804-b63c-c76b8a0c3254 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.632841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b927b76-2251-4bb9-a384-99348b7439bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.633973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b927b76-2251-4bb9-a384-99348b7439bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.634416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b927b76-2251-4bb9-a384-99348b7439bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.634837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b927b76-2251-4bb9-a384-99348b7439bc admin admin] PATH_INFO: `/v3/projects/622ceb0b8bc14e599b8f0ac3074c0c3e/users/1b7afd1f7b0a4c16ad1aaae6f68e9391/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.637603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b927b76-2251-4bb9-a384-99348b7439bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=622ceb0b8bc14e599b8f0ac3074c0c3e, user_id=1b7afd1f7b0a4c16ad1aaae6f68e9391, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.641462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b927b76-2251-4bb9-a384-99348b7439bc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.652787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 907/1834] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:03 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:03.656655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.659677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 928/1835] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:03 2022] PUT /identity/v3/projects/622ceb0b8bc14e599b8f0ac3074c0c3e/users/1b7afd1f7b0a4c16ad1aaae6f68e9391/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:03.674248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.675235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.675235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.693073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55fb24-d0c4-4db0-abe0-ddad92c0d2e2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.724878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] MFA Rules not processed for user `1b7afd1f7b0a4c16ad1aaae6f68e9391`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:03.727134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:03.838061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.838808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.839084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.839512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.840173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.843521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:03.862088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 929/1836] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:03.880418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.882023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:03.884009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 908/1837] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:03.901087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:03.933344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f85b5f-e00d-4213-b122-d598c6d7cb07 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:03.949410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:03.950189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:03.950468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:03.950769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:03.951616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:03.956062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:04.006970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 909/1838] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:04.009443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:04.014255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:04.044515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900d1ff-bb1a-4860-9bcf-e3679d5a60ca None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:04.055688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:04.057030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:04.057320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:04.057590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:04.070401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97138649-3ece-430a-96f3-2e5097f8a735 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:04.091724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:04.096407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:04.098730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:04.099455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:04.099749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:04.100027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] PATH_INFO: `/v3/projects/da0ed3e905604c2ca005d3f33ce03b98` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:04.104605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0ed3e905604c2ca005d3f33ce03b98)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:04.107224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:04.136950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 930/1839] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:04.138848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:04.175171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fc466-3a62-4e0e-94f4-d882f239254e service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:04.197470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:04.199308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:04.202289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:04.202600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] PATH_INFO: `/v3/projects/d8138879c22a452c93b38065b1b33e9a/users/e62e4349364e41c6b39776e560d7e3bb/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:04.231919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:04.243098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8138879c22a452c93b38065b1b33e9a, user_id=e62e4349364e41c6b39776e560d7e3bb, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:04.246659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:04.273056 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 931/1840] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:04 2022] PUT /identity/v3/projects/d8138879c22a452c93b38065b1b33e9a/users/e62e4349364e41c6b39776e560d7e3bb/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:04.286778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:04.298910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:04.317335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:04.402290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ba302-fe41-4459-b984-ed2b8cf1c13f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:04.407086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0ed3e905604c2ca005d3f33ce03b98', 'request_id': 'req-124f8282-d571-4739-b318-9d1431046647'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:04.454540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0ed3e905604c2ca005d3f33ce03b98', 'request_id': 'req-124f8282-d571-4739-b318-9d1431046647'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:04.488805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0ed3e905604c2ca005d3f33ce03b98', 'request_id': 'req-124f8282-d571-4739-b318-9d1431046647'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:04.515682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa4fd4-a7cc-4384-aa4b-84a929710da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:04.516318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4fd4-a7cc-4384-aa4b-84a929710da3 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:04.516659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4fd4-a7cc-4384-aa4b-84a929710da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:04.516923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4fd4-a7cc-4384-aa4b-84a929710da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:04.520724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4eaa4fd4-a7cc-4384-aa4b-84a929710da3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:04.553894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] The token cache is being invalidate because project da0ed3e905604c2ca005d3f33ce03b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:04.554285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:04.562843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-124f8282-d571-4739-b318-9d1431046647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:04.603830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 910/1841] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:04 2022] DELETE /identity/v3/projects/da0ed3e905604c2ca005d3f33ce03b98 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:04.619134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef22ab-40db-49c4-90e3-755c37816e55 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:04.649797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef22ab-40db-49c4-90e3-755c37816e55 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:04.653867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef22ab-40db-49c4-90e3-755c37816e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:04.688769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa4fd4-a7cc-4384-aa4b-84a929710da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:04.694873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa4fd4-a7cc-4384-aa4b-84a929710da3 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:04.714276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 932/1842] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:04.717380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2dc4-4c69-432e-9f36-71d90c10979b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:04.717702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2dc4-4c69-432e-9f36-71d90c10979b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:04.717988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2dc4-4c69-432e-9f36-71d90c10979b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:04.722703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 933/1843] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:11:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:11:04.725579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b2dc4-4c69-432e-9f36-71d90c10979b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:04.729330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c46b2dc4-4c69-432e-9f36-71d90c10979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:04.734254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c6ef22ab-40db-49c4-90e3-755c37816e55 None None] MFA Rules not processed for user `e62e4349364e41c6b39776e560d7e3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:04.735842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c6ef22ab-40db-49c4-90e3-755c37816e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:04.876490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b2dc4-4c69-432e-9f36-71d90c10979b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:04.883869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:04.885600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:04.886282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:04.886858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] PATH_INFO: `/v3/users/4c200db8106d4195a98758b86361895d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:04.892571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c200db8106d4195a98758b86361895d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:04.895503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:04.897695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:05.011232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c200db8106d4195a98758b86361895d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:05.013800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c200db8106d4195a98758b86361895d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:05.048297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c200db8106d4195a98758b86361895d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:05.051221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c200db8106d4195a98758b86361895d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:05.064792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c200db8106d4195a98758b86361895d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:05.076641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 911/1844] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:05.085453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083380b8-0c4b-4a51-a562-045f05882d8e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.087405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083380b8-0c4b-4a51-a562-045f05882d8e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.087405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083380b8-0c4b-4a51-a562-045f05882d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.104216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 934/1845] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:04 2022] DELETE /identity/v3/users/4c200db8106d4195a98758b86361895d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:05.105062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:05.107890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:05.178493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-083380b8-0c4b-4a51-a562-045f05882d8e None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:05.185682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-083380b8-0c4b-4a51-a562-045f05882d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:05.323179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18da569-7a16-4d2e-ba26-b2eeb0480370 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:05.347844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:05.352292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.352292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.352914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.354485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:05.363468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:05.428956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 912/1846] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:05.433154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 935/1847] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:05.438737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083380b8-0c4b-4a51-a562-045f05882d8e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:05.482686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083380b8-0c4b-4a51-a562-045f05882d8e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:05.524642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:05.547520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:05.581820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:05.608860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420b13c-762d-4c34-9137-04481815e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:05.610767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420b13c-762d-4c34-9137-04481815e322 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.611208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420b13c-762d-4c34-9137-04481815e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.612043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420b13c-762d-4c34-9137-04481815e322 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.614304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420b13c-762d-4c34-9137-04481815e322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:05.626960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420b13c-762d-4c34-9137-04481815e322 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:05.689390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 913/1848] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:05 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:05.692340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12203-80b3-45bc-8573-058072de7f7b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.693829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12203-80b3-45bc-8573-058072de7f7b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.694627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12203-80b3-45bc-8573-058072de7f7b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.700396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 914/1849] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:11:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:11:05.702016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12203-80b3-45bc-8573-058072de7f7b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:05.739844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12203-80b3-45bc-8573-058072de7f7b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:05.750506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:05.751431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.751712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.751995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.752714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:05.754412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:05.786408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 915/1850] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:05.787459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:05.792955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:05.824640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179cee0-6b19-45aa-8d78-8486df598168 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:05.836942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:05.840217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.840539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.840814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] PATH_INFO: `/v3/projects/4ee88cea2b7f49a9a75dc4a7bbab08bb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.845369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee88cea2b7f49a9a75dc4a7bbab08bb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:05.849985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:05.858106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:05.874076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13259a0-2b76-446e-add0-ecc786f2bc24 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:05.897286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:05.898199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:05.898640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:05.899070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:05.914290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:05.916549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:05.945044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 936/1851] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:05.946244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:05.958657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be27a-ee23-4bf5-ac0b-3b8a1bd4bb87 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:05.991402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee88cea2b7f49a9a75dc4a7bbab08bb', 'request_id': 'req-9558b405-fc03-4afd-9849-215c0435cce9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.001405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee88cea2b7f49a9a75dc4a7bbab08bb', 'request_id': 'req-9558b405-fc03-4afd-9849-215c0435cce9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.019565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee88cea2b7f49a9a75dc4a7bbab08bb', 'request_id': 'req-9558b405-fc03-4afd-9849-215c0435cce9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.043131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] The token cache is being invalidate because project 4ee88cea2b7f49a9a75dc4a7bbab08bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:06.046394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.048897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.055295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 916/1852] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:05 2022] DELETE /identity/v3/projects/4ee88cea2b7f49a9a75dc4a7bbab08bb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:06.061604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:06.065263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:06.133937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e4138-203e-4f0b-b153-cf22d27af794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:06.134883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e4138-203e-4f0b-b153-cf22d27af794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.135240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e4138-203e-4f0b-b153-cf22d27af794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.152126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e4138-203e-4f0b-b153-cf22d27af794 admin admin] PATH_INFO: `/v3/projects/fa8b37eef57a4672b91e88617bcd6bf6/users/e96da5dfeba440b692f41d5c5109e771/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.180120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e4138-203e-4f0b-b153-cf22d27af794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8b37eef57a4672b91e88617bcd6bf6, user_id=e96da5dfeba440b692f41d5c5109e771, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:06.184956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e4138-203e-4f0b-b153-cf22d27af794 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.227082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 937/1853] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:05 2022] PUT /identity/v3/projects/fa8b37eef57a4672b91e88617bcd6bf6/users/e96da5dfeba440b692f41d5c5109e771/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:06.228557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.228852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.229128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.237659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b405-fc03-4afd-9849-215c0435cce9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:06.288172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:06.289831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:06.338267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:06.347758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:06.350894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.353201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.353716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] PATH_INFO: `/v3/users/d3b22c03c1a046058d125fc5cf9c501b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.356324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b22c03c1a046058d125fc5cf9c501b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:06.362558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.470099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 938/1854] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:11:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:06.472249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:06.486952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b22c03c1a046058d125fc5cf9c501b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.488266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:06.532083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fb6bc-961e-42c8-8588-312792f245de None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:06.533493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b22c03c1a046058d125fc5cf9c501b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.550114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd4fc9-2bee-41b5-b513-8e18db4b7830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:06.550949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4fc9-2bee-41b5-b513-8e18db4b7830 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.551570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4fc9-2bee-41b5-b513-8e18db4b7830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.552314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4fc9-2bee-41b5-b513-8e18db4b7830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.555635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd4fc9-2bee-41b5-b513-8e18db4b7830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:06.556749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b22c03c1a046058d125fc5cf9c501b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.558984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd4fc9-2bee-41b5-b513-8e18db4b7830 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.560086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b22c03c1a046058d125fc5cf9c501b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.561501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b22c03c1a046058d125fc5cf9c501b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:06.612912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 917/1856] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:06 2022] DELETE /identity/v3/users/d3b22c03c1a046058d125fc5cf9c501b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:06.613766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:06.614235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 939/1856] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:06.618390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:06.845509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024353ab-67ac-4869-8163-478d624be94f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:06.854399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:06.855776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.857156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.857532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] PATH_INFO: `/v3/projects/fa8b37eef57a4672b91e88617bcd6bf6/users/e96da5dfeba440b692f41d5c5109e771/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.860324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8b37eef57a4672b91e88617bcd6bf6, user_id=e96da5dfeba440b692f41d5c5109e771, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:06.868069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:06.917455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:06.918109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:06.918109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:06.921262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 918/1857] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:06 2022] PUT /identity/v3/projects/fa8b37eef57a4672b91e88617bcd6bf6/users/e96da5dfeba440b692f41d5c5109e771/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:07.015167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] MFA Rules not processed for user `e96da5dfeba440b692f41d5c5109e771`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:07.016833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.141674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:07.180020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 940/1858] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:07.194347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:07.197816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.214034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:07.215633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.325205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f303e-3831-4a54-9002-f58da429d53d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:07.340381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:07.341060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.341338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.341611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.344794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.387576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:07.408783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac64048-9e23-46aa-94b3-2b6ab9bd9c4f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:07.421183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584015c-5e42-4313-b0b3-283ba8fa5d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:07.422028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584015c-5e42-4313-b0b3-283ba8fa5d7d service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.422597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584015c-5e42-4313-b0b3-283ba8fa5d7d service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.426069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584015c-5e42-4313-b0b3-283ba8fa5d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.428638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2584015c-5e42-4313-b0b3-283ba8fa5d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.444783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584015c-5e42-4313-b0b3-283ba8fa5d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:07.446591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584015c-5e42-4313-b0b3-283ba8fa5d7d service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:07.450352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:07.452762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:07.460778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 941/1859] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:07.462264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959055e5-b35c-4ea5-9abe-7af23c6b3d64 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.462562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959055e5-b35c-4ea5-9abe-7af23c6b3d64 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.462845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959055e5-b35c-4ea5-9abe-7af23c6b3d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.471878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 919/1860] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:07.473527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:07.475659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.487582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-959055e5-b35c-4ea5-9abe-7af23c6b3d64 None None] MFA Rules not processed for user `b531d7ca59814d359b30264d2c9f7116`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:07.489742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-959055e5-b35c-4ea5-9abe-7af23c6b3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.565209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 942/1861] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:07.584453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4e060-acc1-4caa-bc17-d43a3c2d7fd8 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:07.591676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:07.593068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.593495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.594079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] PATH_INFO: `/v3/projects/ca832d8a08744e8ba3b0c74f4a4dfe37` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.595506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca832d8a08744e8ba3b0c74f4a4dfe37)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:07.598679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:07.662516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca832d8a08744e8ba3b0c74f4a4dfe37', 'request_id': 'req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.677444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca832d8a08744e8ba3b0c74f4a4dfe37', 'request_id': 'req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.687085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca832d8a08744e8ba3b0c74f4a4dfe37', 'request_id': 'req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.707661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] The token cache is being invalidate because project ca832d8a08744e8ba3b0c74f4a4dfe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:07.707947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.708753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fa4bef0d-60ce-470d-beb8-ffdb2bba8de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:07.710648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 920/1862] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:07 2022] DELETE /identity/v3/projects/ca832d8a08744e8ba3b0c74f4a4dfe37 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:07.717392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd80ed-fdc5-4df9-aa65-bba58482de00 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.718758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd80ed-fdc5-4df9-aa65-bba58482de00 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.719299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd80ed-fdc5-4df9-aa65-bba58482de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.753252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-60bd80ed-fdc5-4df9-aa65-bba58482de00 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:07.754538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-60bd80ed-fdc5-4df9-aa65-bba58482de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.916280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 943/1863] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:07.923931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc13ff-7e5a-49e3-bac9-b53d829c31ea None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:07.924440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc13ff-7e5a-49e3-bac9-b53d829c31ea None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:07.924736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc13ff-7e5a-49e3-bac9-b53d829c31ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:07.967279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-bacc13ff-7e5a-49e3-bac9-b53d829c31ea None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:07.968470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bacc13ff-7e5a-49e3-bac9-b53d829c31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:07.988610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 921/1864] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:08.003928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd80ed-fdc5-4df9-aa65-bba58482de00 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.010523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd80ed-fdc5-4df9-aa65-bba58482de00 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.018901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.019902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.020292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.022288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.023649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:08.024602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.026830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.031254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:08.049671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 944/1865] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:08.056351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc13ff-7e5a-49e3-bac9-b53d829c31ea None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.069586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc13ff-7e5a-49e3-bac9-b53d829c31ea None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.075517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.076340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.076469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.076659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.077283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.079205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.120914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 922/1866] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:08.123239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.142810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2314da0-431d-44c6-bced-ce05bd1f4e26 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.195763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.197522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.275016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.275679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.275956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.276226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.276857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.279656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.283295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:08.326964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 945/1867] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:08.332167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.347251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1dfff-ade9-4891-8242-60207e2aacaa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.354296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.355058 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.355515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.355922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.357297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.359038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.359203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ddc2-9e07-4301-a932-900b4ec8c406 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.372412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.373450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.373619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.373896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] PATH_INFO: `/v3/projects/244dafe6c40346d7a5718985c0634f4e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.375046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 946/1868] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:08.377355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.377710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=244dafe6c40346d7a5718985c0634f4e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.380139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.391713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34be98-b5ad-45e9-809c-40b47433a2aa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.397017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.397650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.397915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.398188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.398831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.400572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.415343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 947/1869] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:08.419615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.430541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d719a6-3fda-4599-bc7e-fa98b3cd89f4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.435983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedc436-b906-47a8-88d7-f39efb2acfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.436832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc436-b906-47a8-88d7-f39efb2acfe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.437170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc436-b906-47a8-88d7-f39efb2acfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.437454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc436-b906-47a8-88d7-f39efb2acfe9 admin admin] PATH_INFO: `/v3/projects/ed69b7b7c60249fc817ff44192050aed/users/d33720da34314ecdbdbbc0e556400732/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.456673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedc436-b906-47a8-88d7-f39efb2acfe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed69b7b7c60249fc817ff44192050aed, user_id=d33720da34314ecdbdbbc0e556400732, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.458739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244dafe6c40346d7a5718985c0634f4e', 'request_id': 'req-4a4b2214-241d-41e0-8a2a-f7fb01272cba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.459919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedc436-b906-47a8-88d7-f39efb2acfe9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.469112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244dafe6c40346d7a5718985c0634f4e', 'request_id': 'req-4a4b2214-241d-41e0-8a2a-f7fb01272cba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.477670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244dafe6c40346d7a5718985c0634f4e', 'request_id': 'req-4a4b2214-241d-41e0-8a2a-f7fb01272cba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.480469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 948/1870] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:08 2022] PUT /identity/v3/projects/ed69b7b7c60249fc817ff44192050aed/users/d33720da34314ecdbdbbc0e556400732/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:08.492608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.493204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.493630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.513623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] The token cache is being invalidate because project 244dafe6c40346d7a5718985c0634f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:08.514064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.514859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4a4b2214-241d-41e0-8a2a-f7fb01272cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.520127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 923/1871] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:08 2022] DELETE /identity/v3/projects/244dafe6c40346d7a5718985c0634f4e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:08.522688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeedd8-fd3e-409c-881c-5783b470fca1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.523653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeedd8-fd3e-409c-881c-5783b470fca1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.523653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeedd8-fd3e-409c-881c-5783b470fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.541643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] MFA Rules not processed for user `d33720da34314ecdbdbbc0e556400732`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:08.547391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.568528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4cbeedd8-fd3e-409c-881c-5783b470fca1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:08.569798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4cbeedd8-fd3e-409c-881c-5783b470fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.686019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 949/1872] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:08.687323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.691205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.725491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 924/1873] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:08.732723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.733272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.733727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.769288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:08.770587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.777134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:08.787313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 925/1874] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:08.788435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.791255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.812550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342191b-e4bf-4b0e-b1a3-08d79e43c5a5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.818584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.819534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.819892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.820267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] PATH_INFO: `/v3/users/31be3c6a49444ec7bc297d18ddd4c2b4` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.821736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31be3c6a49444ec7bc297d18ddd4c2b4)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.824342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.853506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9e0e-49b6-427d-846a-128ed4be05ef None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:08.863144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:08.877635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:08.878671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:08.880138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:08.881658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:08.887970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:08.897034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:08.899652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31be3c6a49444ec7bc297d18ddd4c2b4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.921865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31be3c6a49444ec7bc297d18ddd4c2b4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.933914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31be3c6a49444ec7bc297d18ddd4c2b4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.936404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31be3c6a49444ec7bc297d18ddd4c2b4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.939028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31be3c6a49444ec7bc297d18ddd4c2b4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:08.952727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 950/1875] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:08.952727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.958093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:08.967888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 926/1876] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:08 2022] DELETE /identity/v3/users/31be3c6a49444ec7bc297d18ddd4c2b4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:08.969315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:08.969921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.068235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a48a-0563-434b-a340-accb21a84195 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.073811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9041-8ed4-47d9-9fa7-befa5e646956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.074431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9041-8ed4-47d9-9fa7-befa5e646956 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.074822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9041-8ed4-47d9-9fa7-befa5e646956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.075293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9041-8ed4-47d9-9fa7-befa5e646956 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.076365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9041-8ed4-47d9-9fa7-befa5e646956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:09.076673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9041-8ed4-47d9-9fa7-befa5e646956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.078144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e06d-9261-4e67-93de-04946e9de4f4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.078282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9041-8ed4-47d9-9fa7-befa5e646956 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.083886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e0dd-c4b2-43ac-bbe4-e4326a83653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.084785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e0dd-c4b2-43ac-bbe4-e4326a83653c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.085161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e0dd-c4b2-43ac-bbe4-e4326a83653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.085529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e0dd-c4b2-43ac-bbe4-e4326a83653c admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.086324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e0dd-c4b2-43ac-bbe4-e4326a83653c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.101424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e0dd-c4b2-43ac-bbe4-e4326a83653c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.114542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 951/1877] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:09.116065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4ba64-0fae-4cfa-8424-0ef0c646eea4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.116396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4ba64-0fae-4cfa-8424-0ef0c646eea4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.116674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4ba64-0fae-4cfa-8424-0ef0c646eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.137937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4ea4ba64-0fae-4cfa-8424-0ef0c646eea4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:09.139158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4ea4ba64-0fae-4cfa-8424-0ef0c646eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.144549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 927/1878] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:08 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:09.144549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ec90-0eb8-4206-bc6c-afffb910dce8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.144549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ec90-0eb8-4206-bc6c-afffb910dce8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.144549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ec90-0eb8-4206-bc6c-afffb910dce8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.145897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 928/1879] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 08:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:11:09.146580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ec90-0eb8-4206-bc6c-afffb910dce8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.152636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 952/1880] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:09.152636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4ba64-0fae-4cfa-8424-0ef0c646eea4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.162725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4ba64-0fae-4cfa-8424-0ef0c646eea4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.169451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b44ae-9594-486c-88c8-0431c318a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.170588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b44ae-9594-486c-88c8-0431c318a246 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.170976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b44ae-9594-486c-88c8-0431c318a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.171355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b44ae-9594-486c-88c8-0431c318a246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.172056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ec90-0eb8-4206-bc6c-afffb910dce8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.172494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b44ae-9594-486c-88c8-0431c318a246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.174370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b44ae-9594-486c-88c8-0431c318a246 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.180284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.180907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.181180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.181451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.182085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.184356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.189917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 953/1881] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:09.189917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4bb04-9220-4224-96cd-b0ac55d91626 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.189917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4bb04-9220-4224-96cd-b0ac55d91626 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.189917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4bb04-9220-4224-96cd-b0ac55d91626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.220776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-23e4bb04-9220-4224-96cd-b0ac55d91626 None None] MFA Rules not processed for user `465160a7e1c24601b83be37681ef322d`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:09.224310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-23e4bb04-9220-4224-96cd-b0ac55d91626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.233683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 929/1882] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:09 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:09.233683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.234033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.355393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee2639-b106-44cb-a0f1-511edbb195ba admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.357382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 954/1883] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:11:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:09.358768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4bb04-9220-4224-96cd-b0ac55d91626 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.362101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.363804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.364446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.364899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.374287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4bb04-9220-4224-96cd-b0ac55d91626 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.421914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:09.439018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:09.448975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.449641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.450625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.450903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] PATH_INFO: `/v3/projects/9a00ec6be2f14e1088a7dd5ae2fd5acc/users/cf54edca875046499f127b3c814c8efd/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.459186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.460699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.466571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a00ec6be2f14e1088a7dd5ae2fd5acc, user_id=cf54edca875046499f127b3c814c8efd, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.469265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.470805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 930/1884] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:09.471614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.481494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61fc18-d3ce-442b-8a7a-8564e6c6e620 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.485619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 955/1885] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:09 2022] PUT /identity/v3/projects/9a00ec6be2f14e1088a7dd5ae2fd5acc/users/cf54edca875046499f127b3c814c8efd/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:09.488624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.550510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.551291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.551663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.552224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.553032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.555576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.560077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211136d-3ddd-426e-abca-4dbfc6069dc2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.565453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.566992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.567319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.567725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.577904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.579279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.581211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 931/1886] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:09 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:09.582236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.587144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.588393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 956/1887] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:09.589273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.603044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4418a-a9ea-4495-a6f2-c94ddf59cf71 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.609521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.610266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.610557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.610834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.611802 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.613754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.629453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 957/1888] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:09.629453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.639558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db3626-c5cd-4f79-aa5a-12eef4af9a11 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.645048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.645653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.645977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.646478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.646939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.648717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.660879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 958/1889] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:09.664022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9a1f4-b0b8-4fe5-bbb1-f13ca9640045 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.664988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.668626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64705c52-8016-4016-95b0-ee28e78a3356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.669347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64705c52-8016-4016-95b0-ee28e78a3356 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.669680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64705c52-8016-4016-95b0-ee28e78a3356 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.670021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64705c52-8016-4016-95b0-ee28e78a3356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.673745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-64705c52-8016-4016-95b0-ee28e78a3356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.675863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af333758-6ed7-480a-9d6f-c3f7cca61643 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.681653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.682471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.682753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.683162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] PATH_INFO: `/v3/projects/9a00ec6be2f14e1088a7dd5ae2fd5acc/users/cf54edca875046499f127b3c814c8efd/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.686901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a00ec6be2f14e1088a7dd5ae2fd5acc, user_id=cf54edca875046499f127b3c814c8efd, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.690044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.719996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 959/1890] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:09 2022] PUT /identity/v3/projects/9a00ec6be2f14e1088a7dd5ae2fd5acc/users/cf54edca875046499f127b3c814c8efd/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:09.719996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.787402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64705c52-8016-4016-95b0-ee28e78a3356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.789452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64705c52-8016-4016-95b0-ee28e78a3356 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.800969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 932/1891] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:09.802939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.803743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.804446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.849157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb564bf-e665-4f0d-a529-9f305a0976c3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.852083 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] MFA Rules not processed for user `cf54edca875046499f127b3c814c8efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:09.854212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:09.865230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.866173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.866560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.866846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.867552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.872714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:09.880413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:09.908893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 960/1892] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:09.914107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:09.936486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeba194-99b0-4d85-a994-d010a6e8fd6e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:09.942928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60147c-968f-4e86-8fab-6454ac12fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:09.943707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60147c-968f-4e86-8fab-6454ac12fe28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:09.944004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60147c-968f-4e86-8fab-6454ac12fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:09.944271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60147c-968f-4e86-8fab-6454ac12fe28 admin admin] PATH_INFO: `/v3/projects/ad8b0421a4d34c5da47ec48b45a3b0f1/users/18ef01d6fae545549497ec4e7406b09b/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:09.978424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60147c-968f-4e86-8fab-6454ac12fe28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8b0421a4d34c5da47ec48b45a3b0f1, user_id=18ef01d6fae545549497ec4e7406b09b, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:09.982331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60147c-968f-4e86-8fab-6454ac12fe28 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.062734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 933/1893] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:10.063754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.070884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.072566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 961/1894] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:09 2022] PUT /identity/v3/projects/ad8b0421a4d34c5da47ec48b45a3b0f1/users/18ef01d6fae545549497ec4e7406b09b/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:10.098000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf1b72-87a8-40f3-b1bf-ea9abaa20f2d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.100481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.100856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.101211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.120784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:10.170815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] MFA Rules not processed for user `18ef01d6fae545549497ec4e7406b09b`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:10.172480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.232697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.233397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.233677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.233947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] PATH_INFO: `/v3/projects/12c0d8dc03df40ce9dd937fa26eae619` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.238362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c0d8dc03df40ce9dd937fa26eae619)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.243338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.302298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 962/1895] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:10.304213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.306183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.384983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c0d8dc03df40ce9dd937fa26eae619', 'request_id': 'req-a1642131-6352-4ab4-8320-a4f6cbdf13f9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.406083 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c0d8dc03df40ce9dd937fa26eae619', 'request_id': 'req-a1642131-6352-4ab4-8320-a4f6cbdf13f9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.416579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c0d8dc03df40ce9dd937fa26eae619', 'request_id': 'req-a1642131-6352-4ab4-8320-a4f6cbdf13f9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.444704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] The token cache is being invalidate because project 12c0d8dc03df40ce9dd937fa26eae619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:10.445000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.446255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:10.449655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 934/1896] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:10 2022] DELETE /identity/v3/projects/12c0d8dc03df40ce9dd937fa26eae619 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:10.451624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.453114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.457279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950c46-1e73-47a5-ba2a-86d281fb657f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.580111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:10.582085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.582727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.583010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.583342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.585578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.617970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1642131-6352-4ab4-8320-a4f6cbdf13f9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.647692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.648667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.650799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.651082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.651767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.660429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.749748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 935/1897] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/projects => generated 391 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:10.749966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.750051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.750123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.751946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:10.781341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 963/1898] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:10.781341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:10.796655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:10.817830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b2eee-b66b-4c19-9a9c-03f98a358c9e service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.962509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2ef02-55ab-4ce2-b591-58904a1cd0c9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:10.983529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.984402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:10.984648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.985060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.985475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.986251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.986699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:10.988035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:10.988583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] PATH_INFO: `/v3/users/dde8201fb9c948228a73272d50787965` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:10.992390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde8201fb9c948228a73272d50787965)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:10.995774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:10.998020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:11.040231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 964/1899] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:10 2022] POST /identity/v3/users => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:11.046337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:11.080010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b48e6-430c-463e-a1e8-d7b647ed9718 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:11.091744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:11.092538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:11.093255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:11.093366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:11.094153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:11.097238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:11.118135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 965/1900] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:11.118485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde8201fb9c948228a73272d50787965'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:11.122774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:11.134504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b3bfe-4e18-42d0-94f6-a52c5c3f3856 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:11.140273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:11.140889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:11.141152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:11.141726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] PATH_INFO: `/v3/projects/745df5d09b604ffa95efdc7570e0adbe/users/b28fe52796ba47b29a574be027650c7d/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:11.161633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745df5d09b604ffa95efdc7570e0adbe, user_id=b28fe52796ba47b29a574be027650c7d, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:11.164163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde8201fb9c948228a73272d50787965'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:11.164542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:11.177703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde8201fb9c948228a73272d50787965'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:11.183401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde8201fb9c948228a73272d50787965'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:11.183568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 966/1901] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:11 2022] PUT /identity/v3/projects/745df5d09b604ffa95efdc7570e0adbe/users/b28fe52796ba47b29a574be027650c7d/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:11.183568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:11.183568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:11.185153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde8201fb9c948228a73272d50787965'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:11.210473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 936/1902] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:10 2022] DELETE /identity/v3/users/dde8201fb9c948228a73272d50787965 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:11.210473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:11.210473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:11.286360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1c3e7-70d0-4e08-bf3d-071611f8b545 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:11.301717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:11.356163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c2b49-37ae-4f03-8e2d-1bc4754dc74e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:11.369838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:11.373125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:11.374562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:11.375067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:11.376353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:11.381935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:11.409840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 937/1903] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:11.413882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:11.430453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f05a1-3c40-46fb-85d2-db4d1635934c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:11.440376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97447f29-ec53-4c98-88e4-e1265e31e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:11.441493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97447f29-ec53-4c98-88e4-e1265e31e83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:11.441998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97447f29-ec53-4c98-88e4-e1265e31e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:11.442657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97447f29-ec53-4c98-88e4-e1265e31e83e admin admin] PATH_INFO: `/v3/projects/745df5d09b604ffa95efdc7570e0adbe/users/b28fe52796ba47b29a574be027650c7d/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:11.446019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97447f29-ec53-4c98-88e4-e1265e31e83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=745df5d09b604ffa95efdc7570e0adbe, user_id=b28fe52796ba47b29a574be027650c7d, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:11.449528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:11.451890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97447f29-ec53-4c98-88e4-e1265e31e83e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:11.467296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 938/1904] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:11 2022] PUT /identity/v3/projects/745df5d09b604ffa95efdc7570e0adbe/users/b28fe52796ba47b29a574be027650c7d/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:11.468348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:11.468651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:11.468933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:11.478150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:11.480721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:11.481440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:11.483439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:11.538283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:11.540859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] MFA Rules not processed for user `b28fe52796ba47b29a574be027650c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:11.543058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:11.637901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:11.644561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:11.666904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 967/1905] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:11.744496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 939/1906] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:11.756716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:11.758764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:11.781668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ba4a-a9a8-4577-af68-74b1ebcfda36 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:11.896219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:11.897008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:11.898082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:11.898430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:11.912158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:11.914847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:11.934385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 968/1907] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:12.017423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:12.019142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:12.033591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29159-07ed-450a-9155-04a89e3a74d7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:12.039661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:12.040471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:12.040910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:12.041356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:12.045347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:12.129429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:12.131148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:12.143889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 940/1908] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:12.523180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:12.525704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:12.703323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b827d-5803-4340-a53d-e905156f83d1 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:12.710559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:12.711209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:12.711515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:12.711791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] PATH_INFO: `/v3/projects/76367300d7704bf2b1a1280aa23ece16` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:12.712937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76367300d7704bf2b1a1280aa23ece16)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:12.714867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:12.811947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76367300d7704bf2b1a1280aa23ece16', 'request_id': 'req-4f806701-8602-488c-ac7c-415b7941598d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:12.829422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76367300d7704bf2b1a1280aa23ece16', 'request_id': 'req-4f806701-8602-488c-ac7c-415b7941598d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:12.836088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76367300d7704bf2b1a1280aa23ece16', 'request_id': 'req-4f806701-8602-488c-ac7c-415b7941598d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:12.841616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:12.874263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] The token cache is being invalidate because project 76367300d7704bf2b1a1280aa23ece16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:12.874890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:12.879382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f806701-8602-488c-ac7c-415b7941598d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:12.888314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:12.891511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 969/1909] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:12 2022] DELETE /identity/v3/projects/76367300d7704bf2b1a1280aa23ece16 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:12.914555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535866f2-97ef-4587-b2ab-caa9a63bc84b service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:13.025656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:13.045626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:13.046421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:13.046712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:13.046995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] PATH_INFO: `/v3/users/1b7afd1f7b0a4c16ad1aaae6f68e9391` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:13.054233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7afd1f7b0a4c16ad1aaae6f68e9391)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:13.056526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:13.140133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7afd1f7b0a4c16ad1aaae6f68e9391'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:13.161413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7afd1f7b0a4c16ad1aaae6f68e9391'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:13.172848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7afd1f7b0a4c16ad1aaae6f68e9391'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:13.174215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7afd1f7b0a4c16ad1aaae6f68e9391'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:13.183576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6cd2efec-5ae4-4cbe-bf45-5b802ff9b01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7afd1f7b0a4c16ad1aaae6f68e9391'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:13.210923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 941/1910] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:12 2022] DELETE /identity/v3/users/1b7afd1f7b0a4c16ad1aaae6f68e9391 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:13.965236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292310e-84b4-4f36-a648-be594fd07941 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:13.967154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292310e-84b4-4f36-a648-be594fd07941 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:13.968913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292310e-84b4-4f36-a648-be594fd07941 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:13.973223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 970/1911] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:11:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:11:13.983146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:13.983791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:13.983791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:13.994624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292310e-84b4-4f36-a648-be594fd07941 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:13.997158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d292310e-84b4-4f36-a648-be594fd07941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:14.024807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:14.026055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:14.159927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 942/1912] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:11:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:14.169050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292310e-84b4-4f36-a648-be594fd07941 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:14.179351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:14.180968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:14.201860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:14.202533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:14.202823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:14.203603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] PATH_INFO: `/v3/users/d33720da34314ecdbdbbc0e556400732` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:14.205454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33720da34314ecdbdbbc0e556400732)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:14.209648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:14.221222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe35e6-a532-45e1-9bfc-27a5cd763093 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:14.228505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:14.229434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:14.230050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:14.230633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:14.242532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:14.244548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:14.279784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 943/1913] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:14.328083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33720da34314ecdbdbbc0e556400732'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.329013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33720da34314ecdbdbbc0e556400732'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.361145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33720da34314ecdbdbbc0e556400732'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.362130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33720da34314ecdbdbbc0e556400732'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.400251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c8d7e1b1-5ad5-4f41-990d-6c5649264ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33720da34314ecdbdbbc0e556400732'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.452896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:14.454921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:14.477888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 971/1914] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:13 2022] DELETE /identity/v3/users/d33720da34314ecdbdbbc0e556400732 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:14.482734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:14.483025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:14.483302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:14.491016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8be91-2d07-48a5-9e3b-ea7aef5bae4d service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:14.554687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:14.558865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:14.660403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:14.682009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:14.682769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:14.683116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:14.683483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] PATH_INFO: `/v3/projects/622ceb0b8bc14e599b8f0ac3074c0c3e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:14.685949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622ceb0b8bc14e599b8f0ac3074c0c3e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:14.688469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:14.741599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 972/1915] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:14.753049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:14.754566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:14.786983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:14.824377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622ceb0b8bc14e599b8f0ac3074c0c3e', 'request_id': 'req-6d4875c3-3598-466d-b673-460c7f420f44'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.840829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622ceb0b8bc14e599b8f0ac3074c0c3e', 'request_id': 'req-6d4875c3-3598-466d-b673-460c7f420f44'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.853922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622ceb0b8bc14e599b8f0ac3074c0c3e', 'request_id': 'req-6d4875c3-3598-466d-b673-460c7f420f44'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.885817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] The token cache is being invalidate because project 622ceb0b8bc14e599b8f0ac3074c0c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:14.886225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.888674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d4875c3-3598-466d-b673-460c7f420f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:14.896361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 944/1916] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:14 2022] DELETE /identity/v3/projects/622ceb0b8bc14e599b8f0ac3074c0c3e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:14.902322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995088-0be7-47bb-bb42-0d759b0927db None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:14.902567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995088-0be7-47bb-bb42-0d759b0927db None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:14.903383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995088-0be7-47bb-bb42-0d759b0927db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:14.952929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5a995088-0be7-47bb-bb42-0d759b0927db None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:14.954168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5a995088-0be7-47bb-bb42-0d759b0927db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:14.987669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8bc2f-0b19-4245-83e9-bd7880e55b4b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.155175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 945/1917] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:15.169289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804377d5-4d90-45f9-87cf-ceb88cfbac2c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.170706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.171626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.172074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.172590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804377d5-4d90-45f9-87cf-ceb88cfbac2c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.173020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.173437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804377d5-4d90-45f9-87cf-ceb88cfbac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.178125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:15.223536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.224987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.241339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-804377d5-4d90-45f9-87cf-ceb88cfbac2c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:15.242979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-804377d5-4d90-45f9-87cf-ceb88cfbac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:15.253156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 973/1918] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:15.257327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 946/1919] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:15.264671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.275694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5686a-f26f-4a6b-8807-ece8750e7118 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.281711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.282331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.282612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.282880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.283676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:15.283977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.286075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.305514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 974/1920] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:15.310761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804377d5-4d90-45f9-87cf-ceb88cfbac2c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.334385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804377d5-4d90-45f9-87cf-ceb88cfbac2c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.345022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.345808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.346213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.346919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.347750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.350994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.409630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 947/1921] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:15 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:15.415521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.436278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9928-5131-408a-a5bd-3b100562af4e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.534652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.535448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.535736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.536384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.537121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.539392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.567495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 975/1922] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:15 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:15.569547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.583937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e977a6a-6c96-4639-b7da-2255664f3fa9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.589755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.591209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.591524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.591802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.592452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.594045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.605582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 948/1923] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:15.610577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.621234 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb39f-61ed-40e8-a354-cff4890f822b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.628145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e5a9c-3379-4ea2-a331-e5bee505a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.628773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5a9c-3379-4ea2-a331-e5bee505a52a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.629030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5a9c-3379-4ea2-a331-e5bee505a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.629300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5a9c-3379-4ea2-a331-e5bee505a52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.629936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e5a9c-3379-4ea2-a331-e5bee505a52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.631563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e5a9c-3379-4ea2-a331-e5bee505a52a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.644472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 976/1924] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:15.648384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.666878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f83f-0824-48b7-990e-6649778701b3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.675130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.675787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.676122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.677148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] PATH_INFO: `/v3/projects/5f7079b4ab6b4dc5b7e63a1ab4c40576/users/59ab2d62dcec4ff09e8ca9c8cabd8f0f/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.702495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7079b4ab6b4dc5b7e63a1ab4c40576, user_id=59ab2d62dcec4ff09e8ca9c8cabd8f0f, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.708137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.737594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 949/1925] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:15 2022] PUT /identity/v3/projects/5f7079b4ab6b4dc5b7e63a1ab4c40576/users/59ab2d62dcec4ff09e8ca9c8cabd8f0f/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:15.750615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10b9c7-a112-4617-b601-11a3e8d0a533 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.750905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10b9c7-a112-4617-b601-11a3e8d0a533 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.751195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10b9c7-a112-4617-b601-11a3e8d0a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.784107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ed10b9c7-a112-4617-b601-11a3e8d0a533 None None] MFA Rules not processed for user `59ab2d62dcec4ff09e8ca9c8cabd8f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:15.784989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ed10b9c7-a112-4617-b601-11a3e8d0a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:15.826649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:15.873566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 977/1926] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:15.876792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.895203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:15.944155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e61d7-ea17-4839-b129-18cb6d5a4e0a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:15.948919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:15.949760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:15.950579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:15.950849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:15.951529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:15.953468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:15.984715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 950/1927] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:15 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:15.986512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10b9c7-a112-4617-b601-11a3e8d0a533 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:15.999592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10b9c7-a112-4617-b601-11a3e8d0a533 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.069770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.070467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.070742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.071065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.071752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.073685 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.097404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 978/1928] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:15 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:16.101416 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.113525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2cfd5-f40e-4ad7-bb2a-ae5aacf48d12 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.118208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.118809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.119084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.119351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.120025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.122197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.133561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 951/1929] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:16.138412 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.148347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad5c8e-1716-401a-8a46-aa5f51d4d2e0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.153974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.154640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.154920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.155190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] PATH_INFO: `/v3/projects/c7d4521403144fd584727df949529f31/users/f2ff8339bdf44e1ab110529dadcdeb18/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.172506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d4521403144fd584727df949529f31, user_id=f2ff8339bdf44e1ab110529dadcdeb18, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.175143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.189061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 979/1930] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:16 2022] PUT /identity/v3/projects/c7d4521403144fd584727df949529f31/users/f2ff8339bdf44e1ab110529dadcdeb18/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:16.192948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.205285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357432d-4cc6-4114-b85f-b3885539df28 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.256654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.258697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:16.299162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.300149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.300639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.301133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.302109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.304253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.326951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 952/1931] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:16.331292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.342957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbf09-9ea4-48d0-9cca-7280349ccfe5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.349629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46236cda-d01a-4c82-b773-73f9c25141e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.350308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46236cda-d01a-4c82-b773-73f9c25141e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.350728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46236cda-d01a-4c82-b773-73f9c25141e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.351062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46236cda-d01a-4c82-b773-73f9c25141e2 admin admin] PATH_INFO: `/v3/projects/c7d4521403144fd584727df949529f31/users/f2ff8339bdf44e1ab110529dadcdeb18/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.353588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46236cda-d01a-4c82-b773-73f9c25141e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d4521403144fd584727df949529f31, user_id=f2ff8339bdf44e1ab110529dadcdeb18, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.357871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46236cda-d01a-4c82-b773-73f9c25141e2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.389696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 953/1932] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:16 2022] PUT /identity/v3/projects/c7d4521403144fd584727df949529f31/users/f2ff8339bdf44e1ab110529dadcdeb18/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:16.401817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.404974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.405391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.443064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501fe3-9424-4724-81d5-3e5b3bb0063f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.485876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] MFA Rules not processed for user `f2ff8339bdf44e1ab110529dadcdeb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:16.487064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:16.498017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:16.531114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.532490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.532974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.533407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] PATH_INFO: `/v3/projects/ed69b7b7c60249fc817ff44192050aed` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.535683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed69b7b7c60249fc817ff44192050aed)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.537484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.607710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:16.609484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed69b7b7c60249fc817ff44192050aed', 'request_id': 'req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.612719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 954/1933] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:16.613695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.615103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:16.623343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed69b7b7c60249fc817ff44192050aed', 'request_id': 'req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.630652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa30c5-70f2-4bbe-ab55-513400d7feb1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.637258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed69b7b7c60249fc817ff44192050aed', 'request_id': 'req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.656911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] The token cache is being invalidate because project ed69b7b7c60249fc817ff44192050aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:16.657325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.658113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.662909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 980/1934] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:16 2022] DELETE /identity/v3/projects/ed69b7b7c60249fc817ff44192050aed => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:16.663902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.665524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:16.720460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.721198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.721529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.721888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] PATH_INFO: `/v3/users/88653e434dea4cce8dc3dcac864931b0` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.723085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] RBAC: Authorizing `identity:delete_user(user_id=88653e434dea4cce8dc3dcac864931b0)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.725250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.757210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4b5b-cbdf-405d-9fa6-51bdb96c0ee6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.762532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.763307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.763607 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.763880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.765931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:16.797390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88653e434dea4cce8dc3dcac864931b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.811340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88653e434dea4cce8dc3dcac864931b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.819253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88653e434dea4cce8dc3dcac864931b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.820071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88653e434dea4cce8dc3dcac864931b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.820898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88653e434dea4cce8dc3dcac864931b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:16.834988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 955/1935] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:16 2022] DELETE /identity/v3/users/88653e434dea4cce8dc3dcac864931b0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:16.835945 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.837531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:16.839986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.842074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.851554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 981/1936] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:16.852330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:16.853606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:16.869829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba2d83-1d1f-4e3d-b4de-08548237ed0a service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.893781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:16.920010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52318f2e-b870-4e86-bdc0-fd8dd6e776af admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:16.931472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.933112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.933606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.934136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] PATH_INFO: `/v3/users/cf54edca875046499f127b3c814c8efd` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.935894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf54edca875046499f127b3c814c8efd)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.939975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:16.972110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:16.980102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:16.981354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:16.981807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:16.982268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] PATH_INFO: `/v3/users/18ef01d6fae545549497ec4e7406b09b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:16.983466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ef01d6fae545549497ec4e7406b09b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:16.985410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:17.022733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf54edca875046499f127b3c814c8efd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.052610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf54edca875046499f127b3c814c8efd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.055714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ef01d6fae545549497ec4e7406b09b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.056652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ef01d6fae545549497ec4e7406b09b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.068386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf54edca875046499f127b3c814c8efd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.069451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf54edca875046499f127b3c814c8efd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.070328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ef01d6fae545549497ec4e7406b09b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.070778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7979d6a4-09d4-4f1f-879f-553223219a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf54edca875046499f127b3c814c8efd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.071036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ef01d6fae545549497ec4e7406b09b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.085583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4508701f-c6ad-482e-a45d-db89a059275a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ef01d6fae545549497ec4e7406b09b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.105570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 982/1937] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:16 2022] DELETE /identity/v3/users/18ef01d6fae545549497ec4e7406b09b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:17.107920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:17.108457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:17.109123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:17.117899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 956/1938] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:16 2022] DELETE /identity/v3/users/cf54edca875046499f127b3c814c8efd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:17.119403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:17.119725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:17.120105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:17.149250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:17.150964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.153456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:17.157249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.267468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 983/1939] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:17.318240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:17.320470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.339018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 957/1940] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:17.373691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:17.375501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.444343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:17.469663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba23471-d36c-42d7-839f-afd5ff3a0487 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:17.477179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:17.478752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:17.479346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:17.480023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:17.494351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:17.496209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:17.512965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 984/1941] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:17.514268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:17.516407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.531764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465a9d5-6990-47fb-b157-816e1a3a45f4 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:17.535087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d75f3-3121-42ee-a025-f0b74ca2f2dc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:17.541824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e9f23-3f69-4606-83c1-a2ea39a6037e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:17.542715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9f23-3f69-4606-83c1-a2ea39a6037e service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:17.543006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9f23-3f69-4606-83c1-a2ea39a6037e service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:17.543283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9f23-3f69-4606-83c1-a2ea39a6037e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:17.557118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e9f23-3f69-4606-83c1-a2ea39a6037e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:17.558661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e9f23-3f69-4606-83c1-a2ea39a6037e service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:17.563320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:17.566745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:17.567144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:17.567589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] PATH_INFO: `/v3/users/59ab2d62dcec4ff09e8ca9c8cabd8f0f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:17.570483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ab2d62dcec4ff09e8ca9c8cabd8f0f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:17.584519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 958/1942] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:17.584880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:17.640418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ab2d62dcec4ff09e8ca9c8cabd8f0f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.641595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ab2d62dcec4ff09e8ca9c8cabd8f0f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.662990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ab2d62dcec4ff09e8ca9c8cabd8f0f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.666123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ab2d62dcec4ff09e8ca9c8cabd8f0f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.678586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ab2d62dcec4ff09e8ca9c8cabd8f0f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:17.704192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 985/1943] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:17 2022] DELETE /identity/v3/users/59ab2d62dcec4ff09e8ca9c8cabd8f0f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:17.710722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:17.711641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:17.711932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:17.747381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:17.749882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.826161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:17.891850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 959/1944] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:17.924082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:17.925812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.962844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:17.964497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:17.991524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48522b5-a547-49e8-bdca-939e03c54cfc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:18.023861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:18.024582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.027213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.027548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] PATH_INFO: `/v3/projects/9a00ec6be2f14e1088a7dd5ae2fd5acc` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.049126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a00ec6be2f14e1088a7dd5ae2fd5acc)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:18.060847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:18.147404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b14d-2c46-4958-a39c-70401045c097 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:18.153573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:18.154437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.154720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.155123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.172316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:18.174165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:18.207257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a00ec6be2f14e1088a7dd5ae2fd5acc', 'request_id': 'req-04dc7ca7-c5d7-496d-94cb-2d88346402d4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.221005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 986/1945] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:18.224978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a00ec6be2f14e1088a7dd5ae2fd5acc', 'request_id': 'req-04dc7ca7-c5d7-496d-94cb-2d88346402d4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.226358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:18.235253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a00ec6be2f14e1088a7dd5ae2fd5acc', 'request_id': 'req-04dc7ca7-c5d7-496d-94cb-2d88346402d4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.235697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:18.264738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] The token cache is being invalidate because project 9a00ec6be2f14e1088a7dd5ae2fd5acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:18.265032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.267990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.272329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 960/1946] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:17 2022] DELETE /identity/v3/projects/9a00ec6be2f14e1088a7dd5ae2fd5acc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:18.273199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:18.277168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e859d7-8bc2-4626-bf38-e58fb95e4c0f service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:18.278333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:18.392323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7ca7-c5d7-496d-94cb-2d88346402d4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:18.404167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:18.406285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.406691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.408021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:18.408629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] PATH_INFO: `/v3/projects/ad8b0421a4d34c5da47ec48b45a3b0f1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.410009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.410803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8b0421a4d34c5da47ec48b45a3b0f1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:18.411301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.412421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] PATH_INFO: `/v3/projects/526df9f9bff747988e4c2ab83b65786a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.414466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:18.415275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526df9f9bff747988e4c2ab83b65786a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:18.417464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:18.423442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:18.515097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526df9f9bff747988e4c2ab83b65786a', 'request_id': 'req-4d260a78-6e80-432f-9c05-a7a64e7e58f7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.521030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8b0421a4d34c5da47ec48b45a3b0f1', 'request_id': 'req-2f755ecc-ead3-4cd4-9f97-39a995dc2398'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.522851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526df9f9bff747988e4c2ab83b65786a', 'request_id': 'req-4d260a78-6e80-432f-9c05-a7a64e7e58f7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.530038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526df9f9bff747988e4c2ab83b65786a', 'request_id': 'req-4d260a78-6e80-432f-9c05-a7a64e7e58f7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.555229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] The token cache is being invalidate because project 526df9f9bff747988e4c2ab83b65786a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:18.555776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.556590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d260a78-6e80-432f-9c05-a7a64e7e58f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.562754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 987/1947] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:18 2022] DELETE /identity/v3/projects/526df9f9bff747988e4c2ab83b65786a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:18.565533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.566391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.566677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.567125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8b0421a4d34c5da47ec48b45a3b0f1', 'request_id': 'req-2f755ecc-ead3-4cd4-9f97-39a995dc2398'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.575895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8b0421a4d34c5da47ec48b45a3b0f1', 'request_id': 'req-2f755ecc-ead3-4cd4-9f97-39a995dc2398'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.578168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:18.591235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:18.592796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:18.598963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] The token cache is being invalidate because project ad8b0421a4d34c5da47ec48b45a3b0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:18.599685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.600395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.602477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 961/1948] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:18 2022] DELETE /identity/v3/projects/ad8b0421a4d34c5da47ec48b45a3b0f1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:18.603290 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:18.604763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:18.694224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 988/1949] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:18.697074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:18.704486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:18.726114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f755ecc-ead3-4cd4-9f97-39a995dc2398 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:18.729353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18451f0-43e4-4c55-9c75-0170cccbd017 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:18.736576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:18.737213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.737489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.737759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] PATH_INFO: `/v3/users/e62e4349364e41c6b39776e560d7e3bb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.738949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:18.740843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62e4349364e41c6b39776e560d7e3bb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:18.741325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:18.742142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.742812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.743505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] PATH_INFO: `/v3/users/b28fe52796ba47b29a574be027650c7d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.746159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28fe52796ba47b29a574be027650c7d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:18.750298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:18.827619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28fe52796ba47b29a574be027650c7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.828478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28fe52796ba47b29a574be027650c7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.830848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62e4349364e41c6b39776e560d7e3bb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.845187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62e4349364e41c6b39776e560d7e3bb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.845621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28fe52796ba47b29a574be027650c7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.846383 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28fe52796ba47b29a574be027650c7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.854251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62e4349364e41c6b39776e560d7e3bb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.855135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62e4349364e41c6b39776e560d7e3bb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.855268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28fe52796ba47b29a574be027650c7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.856653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8082bfbc-f527-4ff8-995e-55a8e51bf17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62e4349364e41c6b39776e560d7e3bb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:18.875587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 962/1950] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:18 2022] DELETE /identity/v3/users/e62e4349364e41c6b39776e560d7e3bb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:18.875587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de0e04-caed-44a7-8cff-6c816758dac3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:18.875587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de0e04-caed-44a7-8cff-6c816758dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:18.875587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de0e04-caed-44a7-8cff-6c816758dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:18.879995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 989/1951] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:18 2022] DELETE /identity/v3/users/b28fe52796ba47b29a574be027650c7d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:18.896647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-10de0e04-caed-44a7-8cff-6c816758dac3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:18.897989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-10de0e04-caed-44a7-8cff-6c816758dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:18.979849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 963/1952] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:18.985152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:18.987154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:18.995709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:19.004013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a26f5-3521-45a1-ab18-a7e29473d361 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.013551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.014370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.014944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.015088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.016170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:19.016432 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.018228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.034738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 990/1953] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:19.039570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de0e04-caed-44a7-8cff-6c816758dac3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.052069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de0e04-caed-44a7-8cff-6c816758dac3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.060991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.061599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.061878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.062125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.062770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.064954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.090015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:19.114486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 964/1954] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:19 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:19.118907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.129087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d586b-51f1-459e-ae2f-6217e97d1d39 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.211616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.212370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.212570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.213786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.214451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.217102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.248175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 991/1955] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:19 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:19.252907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.276877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.282224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd26369-0578-42b7-991c-b9748101c0f2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.282775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:19.302606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.303572 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.304069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.306327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.307184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.309882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.339756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 965/1956] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:19.344640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.354744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26805fa-b259-4dcc-8083-ce0b5fdb16cc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.361834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.362489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.362766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.363633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] PATH_INFO: `/v3/projects/5f7079b4ab6b4dc5b7e63a1ab4c40576` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.364870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7079b4ab6b4dc5b7e63a1ab4c40576)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.366071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fac44-2025-4600-a5da-333f9355f71c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.368260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.381520 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.382045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.382544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.382884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.397104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.398848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.413877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 966/1957] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:19.415020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.428386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04ee3-d585-46c0-8854-ca742fcc76f7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.443403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.444660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.444946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.445428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] PATH_INFO: `/v3/projects/3b4015c63b0f4493b67b5a86328559c9/users/5d828d9defc64d8cb97ff8c44d9cd535/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.476682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4015c63b0f4493b67b5a86328559c9, user_id=5d828d9defc64d8cb97ff8c44d9cd535, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.478055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7079b4ab6b4dc5b7e63a1ab4c40576', 'request_id': 'req-cabbf819-189e-447a-a769-8eb622d13947'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.486181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.499069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7079b4ab6b4dc5b7e63a1ab4c40576', 'request_id': 'req-cabbf819-189e-447a-a769-8eb622d13947'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.506547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7079b4ab6b4dc5b7e63a1ab4c40576', 'request_id': 'req-cabbf819-189e-447a-a769-8eb622d13947'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.526124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] The token cache is being invalidate because project 5f7079b4ab6b4dc5b7e63a1ab4c40576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:19.526421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.527193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.540287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 992/1959] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:19 2022] DELETE /identity/v3/projects/5f7079b4ab6b4dc5b7e63a1ab4c40576 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:19.540998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 967/1959] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:19 2022] PUT /identity/v3/projects/3b4015c63b0f4493b67b5a86328559c9/users/5d828d9defc64d8cb97ff8c44d9cd535/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:19.541450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.541788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.543189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:19.552097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:19.627656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983ab5-d55d-4711-abe2-f021e68ee0b8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.633889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbf819-189e-447a-a769-8eb622d13947 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.635225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.636506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.636918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.637993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] PATH_INFO: `/v3/projects/d8138879c22a452c93b38065b1b33e9a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.639743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8138879c22a452c93b38065b1b33e9a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.641011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.641683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.642023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.642247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.643014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] PATH_INFO: `/v3/projects/745df5d09b604ffa95efdc7570e0adbe` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.645537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=745df5d09b604ffa95efdc7570e0adbe)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.647654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.650246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:19.696539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8138879c22a452c93b38065b1b33e9a', 'request_id': 'req-91b38966-249a-4cf0-ad0f-d20df2800a2d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.705323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8138879c22a452c93b38065b1b33e9a', 'request_id': 'req-91b38966-249a-4cf0-ad0f-d20df2800a2d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.710332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745df5d09b604ffa95efdc7570e0adbe', 'request_id': 'req-ae7dde91-ab7c-4616-a8fe-61909566c10e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.712397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8138879c22a452c93b38065b1b33e9a', 'request_id': 'req-91b38966-249a-4cf0-ad0f-d20df2800a2d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.718172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745df5d09b604ffa95efdc7570e0adbe', 'request_id': 'req-ae7dde91-ab7c-4616-a8fe-61909566c10e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.723931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745df5d09b604ffa95efdc7570e0adbe', 'request_id': 'req-ae7dde91-ab7c-4616-a8fe-61909566c10e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.724811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] The token cache is being invalidate because project d8138879c22a452c93b38065b1b33e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:19.725129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.725894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.727665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 968/1960] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:19 2022] DELETE /identity/v3/projects/d8138879c22a452c93b38065b1b33e9a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:19.728224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.729497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:19.740249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] The token cache is being invalidate because project 745df5d09b604ffa95efdc7570e0adbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:19.740543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.741181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7dde91-ab7c-4616-a8fe-61909566c10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.742906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 993/1961] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:19 2022] DELETE /identity/v3/projects/745df5d09b604ffa95efdc7570e0adbe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:19.744075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.744355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.744625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.773003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] MFA Rules not processed for user `5d828d9defc64d8cb97ff8c44d9cd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:19.774218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:19.775532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:19.803541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b38966-249a-4cf0-ad0f-d20df2800a2d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.853978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 994/1962] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:19.858973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:19.863725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:19.874460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.875317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.875742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.876018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] PATH_INFO: `/v3/users/f2ff8339bdf44e1ab110529dadcdeb18` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.877845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ff8339bdf44e1ab110529dadcdeb18)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.878149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125ca9-95cb-4d4f-8745-5d16c877ac75 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:19.880187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.883542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:19.884265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:19.884538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:19.884809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] PATH_INFO: `/v3/users/e96da5dfeba440b692f41d5c5109e771` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:19.885939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96da5dfeba440b692f41d5c5109e771)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:19.888438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:19.952607 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96da5dfeba440b692f41d5c5109e771'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.953750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96da5dfeba440b692f41d5c5109e771'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.956644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ff8339bdf44e1ab110529dadcdeb18'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.972222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ff8339bdf44e1ab110529dadcdeb18'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.974621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96da5dfeba440b692f41d5c5109e771'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.975831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96da5dfeba440b692f41d5c5109e771'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.980130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ff8339bdf44e1ab110529dadcdeb18'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.981040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ff8339bdf44e1ab110529dadcdeb18'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.981734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a2a70a1-176c-4b09-9ac8-5049c3e353f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ff8339bdf44e1ab110529dadcdeb18'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.986374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96da5dfeba440b692f41d5c5109e771'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:19.989316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:19.999610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 969/1963] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:19 2022] DELETE /identity/v3/users/f2ff8339bdf44e1ab110529dadcdeb18 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:20.001107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e933ec9-da33-4ed9-b23d-b2c4404f64ea None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.001586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e933ec9-da33-4ed9-b23d-b2c4404f64ea None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.002000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e933ec9-da33-4ed9-b23d-b2c4404f64ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.010515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 995/1964] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:19 2022] DELETE /identity/v3/users/e96da5dfeba440b692f41d5c5109e771 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:20.010515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:20.025418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.033887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9e933ec9-da33-4ed9-b23d-b2c4404f64ea None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:20.035624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9e933ec9-da33-4ed9-b23d-b2c4404f64ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.119499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5f8c-c6be-4385-a657-efa84528bed0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:20.131617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:20.133622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.133984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.135325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.140006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.167801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 970/1965] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:20.169497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3abc5-6ee0-4121-8918-7724e8738d00 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.169861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3abc5-6ee0-4121-8918-7724e8738d00 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.170209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3abc5-6ee0-4121-8918-7724e8738d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.180933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:20.200920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-47b3abc5-6ee0-4121-8918-7724e8738d00 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:20.202719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-47b3abc5-6ee0-4121-8918-7724e8738d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.226600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 971/1966] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:20.228097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3abc5-6ee0-4121-8918-7724e8738d00 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:20.229136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:20.230788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:20.237888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3abc5-6ee0-4121-8918-7724e8738d00 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:20.244595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:20.245315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.245662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.246001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.247319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:20.247717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:20.250858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:20.266121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 996/1967] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:20.282640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 972/1968] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:20.284510 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:20.308764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49264ff-b0bc-46cf-b0bd-cb0b8929acda service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:20.315598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:20.316558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.316911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.317398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.318156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:20.320772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:20.368995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 997/1969] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:20 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:20.370177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:20.384948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268acbb-34ac-4b75-9d8d-24aec9b62b3f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:20.423199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:20.427818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.532744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:20.533381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.533663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.534285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.534565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:20.536884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:20.560922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2d110-c1bf-41b6-b627-504e3125a356 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:20.576018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:20.577027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.577348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.577691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] PATH_INFO: `/v3/projects/fa8b37eef57a4672b91e88617bcd6bf6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.580618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8b37eef57a4672b91e88617bcd6bf6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:20.582687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:20.597669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 973/1970] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:20 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:20.598601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:20.603772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.634563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:20.635138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963aa6-c1dd-4c3b-acf7-b1bbfc550475 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:20.644117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:20.645190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.645306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.645546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] PATH_INFO: `/v3/projects/c7d4521403144fd584727df949529f31` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.647150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d4521403144fd584727df949529f31)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:20.649831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:20.674901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8b37eef57a4672b91e88617bcd6bf6', 'request_id': 'req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.709620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8b37eef57a4672b91e88617bcd6bf6', 'request_id': 'req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.724013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d4521403144fd584727df949529f31', 'request_id': 'req-b099e225-d5c4-4642-b6f5-267d5797ffb5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.725553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8b37eef57a4672b91e88617bcd6bf6', 'request_id': 'req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.758718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d4521403144fd584727df949529f31', 'request_id': 'req-b099e225-d5c4-4642-b6f5-267d5797ffb5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.760820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] The token cache is being invalidate because project fa8b37eef57a4672b91e88617bcd6bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:20.763570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.764428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.769041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d4521403144fd584727df949529f31', 'request_id': 'req-b099e225-d5c4-4642-b6f5-267d5797ffb5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.770553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 998/1971] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:20 2022] DELETE /identity/v3/projects/fa8b37eef57a4672b91e88617bcd6bf6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:20.771524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:20.776813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.805042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] The token cache is being invalidate because project c7d4521403144fd584727df949529f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:20.805640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.806566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b099e225-d5c4-4642-b6f5-267d5797ffb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:20.809521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 974/1972] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:20 2022] DELETE /identity/v3/projects/c7d4521403144fd584727df949529f31 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:20.811104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69829-3a19-454f-883d-02cf0f18eac9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.813345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69829-3a19-454f-883d-02cf0f18eac9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.813931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69829-3a19-454f-883d-02cf0f18eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.840077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b2a69829-3a19-454f-883d-02cf0f18eac9 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:20.842090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b2a69829-3a19-454f-883d-02cf0f18eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.880709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c3a5-8bf3-40b6-a60d-d865f1647b10 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:20.905204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:20.921807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 975/1973] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:20.923067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ad0c7-a1a2-4894-b590-cccc0d8bbe91 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.923345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ad0c7-a1a2-4894-b590-cccc0d8bbe91 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.923731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ad0c7-a1a2-4894-b590-cccc0d8bbe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.953022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3c0ad0c7-a1a2-4894-b590-cccc0d8bbe91 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:20.954194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61710d03-e090-4d15-8ce5-1620613eb346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:20.954355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3c0ad0c7-a1a2-4894-b590-cccc0d8bbe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.954928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710d03-e090-4d15-8ce5-1620613eb346 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.955267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710d03-e090-4d15-8ce5-1620613eb346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.955638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710d03-e090-4d15-8ce5-1620613eb346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.956352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61710d03-e090-4d15-8ce5-1620613eb346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:20.958030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61710d03-e090-4d15-8ce5-1620613eb346 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:20.963164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 976/1974] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:20.971578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 999/1975] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:20.971742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900e0e-62c3-42fd-85f6-b26ff49a201d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.971742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900e0e-62c3-42fd-85f6-b26ff49a201d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.971742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900e0e-62c3-42fd-85f6-b26ff49a201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.973852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:20.973852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:20.974051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:20.992419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-61900e0e-62c3-42fd-85f6-b26ff49a201d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:20.993576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:20.994019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-61900e0e-62c3-42fd-85f6-b26ff49a201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:20.994865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:21.005328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1000/1976] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:21.005963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.007203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:21.017724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 977/1977] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:21.019878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec6c10-95c7-4b19-926f-00827413595c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.021269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900e0e-62c3-42fd-85f6-b26ff49a201d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.025884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.026617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.026827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.027046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.027816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.029431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.047457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1001/1978] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:21.048572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.050845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900e0e-62c3-42fd-85f6-b26ff49a201d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.057073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.057688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.058082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.058259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.059607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:21.060289 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.062796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.075901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e234a-6b30-4093-b0ca-d92e9c08d788 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.088999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 978/1979] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:21.090932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.094496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.095132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.096860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.096860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.096860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:21.097118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.098530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.107465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289547-c9a0-49f8-9a1a-368c8bbe151e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.120714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.122993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.123432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.124338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] PATH_INFO: `/v3/projects/49e3109629cd497ba44e443c98dee358/users/9864d2d2a6a943f386c6775068933e40/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.145668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1002/1980] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:21.146899 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.162874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e3109629cd497ba44e443c98dee358, user_id=9864d2d2a6a943f386c6775068933e40, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.168486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.171162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c6ac-96d6-4875-a694-a2f96e08ffa2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.178068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c405-ce4a-4721-bdc2-756f099b0cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.180090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c405-ce4a-4721-bdc2-756f099b0cfa admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.180605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c405-ce4a-4721-bdc2-756f099b0cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.181023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c405-ce4a-4721-bdc2-756f099b0cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.181838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c405-ce4a-4721-bdc2-756f099b0cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.185417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c405-ce4a-4721-bdc2-756f099b0cfa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.222953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 979/1981] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:21 2022] PUT /identity/v3/projects/49e3109629cd497ba44e443c98dee358/users/9864d2d2a6a943f386c6775068933e40/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:21.233432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.237766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1003/1982] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/projects => generated 361 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:21.242457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece4c1-4370-4c57-8819-2fdbcdb53a4e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.242817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece4c1-4370-4c57-8819-2fdbcdb53a4e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.243238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece4c1-4370-4c57-8819-2fdbcdb53a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.267491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:21.296426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-98ece4c1-4370-4c57-8819-2fdbcdb53a4e None None] MFA Rules not processed for user `9864d2d2a6a943f386c6775068933e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:21.297796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-98ece4c1-4370-4c57-8819-2fdbcdb53a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:21.408774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1004/1983] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:21.413102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece4c1-4370-4c57-8819-2fdbcdb53a4e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.420005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a655f-1310-45ae-a112-927580ea3936 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.516024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece4c1-4370-4c57-8819-2fdbcdb53a4e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.521895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.522307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.522521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.522768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.523038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.523138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.523314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.523624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.523743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.524285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.525593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.526183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.547764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1005/1984] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/users => generated 281 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:21.548572 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.557515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 980/1985] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/projects => generated 385 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:21.558226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.558324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167e2e-7180-48e9-a401-2dc6bd52220f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.603786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:21.616605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.617222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.617502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.617780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.618402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.620399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.626372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06defb25-866e-4fd6-9d80-ebe5fb056840 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.633172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.633787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.634064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.634650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.635302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.637649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.648634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 981/1986] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:21.648927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1006/1987] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:21.649394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.656287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.659999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4cfba-e409-417e-98e4-4e9f81f6c3fc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.668063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:21.725316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f95f-b467-4369-96a7-7b5b9ee436ca admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.731129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.731842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.732120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.732314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.732430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.732954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.733060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.733233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.733511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.734156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.734596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.736154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.744853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1007/1988] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:21.745689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.756694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7935-cc93-4dae-ad9e-c4f7661e54f3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.758588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 982/1989] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:21.759344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.765254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.766106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.766471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.766835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.768062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.770329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.771093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0218f-ec40-4741-87c6-eb24f3d847ce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.777927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.778487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.778829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.779175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] PATH_INFO: `/v3/projects/1a99ea24b756405eab84b15b6fa867d5/users/11ec91bbf26748adbd36513253a2b0fd/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.796200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1008/1990] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:21.796787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.797228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a99ea24b756405eab84b15b6fa867d5, user_id=11ec91bbf26748adbd36513253a2b0fd, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.800874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.809944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd7990-0417-48a8-9905-32db7cb33bda admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.815768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0bf1e-0d3a-448d-bdda-f730bb40f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.816620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0bf1e-0d3a-448d-bdda-f730bb40f772 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.817468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0bf1e-0d3a-448d-bdda-f730bb40f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.817816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0bf1e-0d3a-448d-bdda-f730bb40f772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.818534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0bf1e-0d3a-448d-bdda-f730bb40f772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.820567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0bf1e-0d3a-448d-bdda-f730bb40f772 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.827858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 983/1991] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:21 2022] PUT /identity/v3/projects/1a99ea24b756405eab84b15b6fa867d5/users/11ec91bbf26748adbd36513253a2b0fd/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:21.828453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.842615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1009/1992] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:21.843809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640178-e24e-4b8f-aa8a-dc4414ca1141 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.844089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640178-e24e-4b8f-aa8a-dc4414ca1141 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.844358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640178-e24e-4b8f-aa8a-dc4414ca1141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.875768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3c640178-e24e-4b8f-aa8a-dc4414ca1141 None None] MFA Rules not processed for user `11ec91bbf26748adbd36513253a2b0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:21.876985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3c640178-e24e-4b8f-aa8a-dc4414ca1141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:21.912684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b744-2df2-47be-a723-07a930e006c2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.918661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.919650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.919926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.920203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.921030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.923466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.938079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 984/1993] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:21.939078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.952956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f32d-4d52-4243-9384-5d78eed2a2ce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.958337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.958954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.959717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.959717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:21.960260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:21.962062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:21.975619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1010/1994] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:21.976429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640178-e24e-4b8f-aa8a-dc4414ca1141 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.984803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 985/1995] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:21.985499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:21.988006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640178-e24e-4b8f-aa8a-dc4414ca1141 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:21.993265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:21.993928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:21.994206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:21.994496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] PATH_INFO: `/v3/projects/49bfe6acf6d0438b8a8b8fec6da23085/users/b316d727f2304b7cb1437bd4e42030b7/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.004854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa73deb-a333-47f8-aeca-ce91c46700b9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.014688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.015448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.015728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.016008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] PATH_INFO: `/v3/projects/a99ced433a0e4117b4cdc012f74f542b/users/ec80cb37c5fc4b4ebecfb550aa3a0dce/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.028929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bfe6acf6d0438b8a8b8fec6da23085, user_id=b316d727f2304b7cb1437bd4e42030b7, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.032036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.033947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99ced433a0e4117b4cdc012f74f542b, user_id=ec80cb37c5fc4b4ebecfb550aa3a0dce, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.036731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.048377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:22.051459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1011/1996] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:21 2022] PUT /identity/v3/projects/49bfe6acf6d0438b8a8b8fec6da23085/users/b316d727f2304b7cb1437bd4e42030b7/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:22.051459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.052331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.055352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 986/1997] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:21 2022] PUT /identity/v3/projects/a99ced433a0e4117b4cdc012f74f542b/users/ec80cb37c5fc4b4ebecfb550aa3a0dce/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:22.066652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.106784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:22.119735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef653e-804d-443a-b22f-e0c3082a59c9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.135510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672db8e-f11b-45f3-a8af-560046865278 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.140377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca8e04-9f2b-4c8f-9642-dee5faad4cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.141004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8e04-9f2b-4c8f-9642-dee5faad4cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.141279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8e04-9f2b-4c8f-9642-dee5faad4cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.141546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8e04-9f2b-4c8f-9642-dee5faad4cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.142177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca8e04-9f2b-4c8f-9642-dee5faad4cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.143839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca8e04-9f2b-4c8f-9642-dee5faad4cf9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.153637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 987/1998] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:22.154804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31b4a-629b-44aa-8e69-5611410a9484 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.155393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31b4a-629b-44aa-8e69-5611410a9484 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.155684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31b4a-629b-44aa-8e69-5611410a9484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.171057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.171735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.172010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.172279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.182796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-76b31b4a-629b-44aa-8e69-5611410a9484 None None] MFA Rules not processed for user `ec80cb37c5fc4b4ebecfb550aa3a0dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:22.184179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-76b31b4a-629b-44aa-8e69-5611410a9484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.233767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.235196 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.245086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1012/1999] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:22.245709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.253129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 988/2000] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:22.258138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b31b4a-629b-44aa-8e69-5611410a9484 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.260366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7efd2-f520-452e-9280-07a640131179 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.266556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.267221 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.267530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.267809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] PATH_INFO: `/v3/projects/49bfe6acf6d0438b8a8b8fec6da23085/users/b316d727f2304b7cb1437bd4e42030b7/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.269769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bfe6acf6d0438b8a8b8fec6da23085, user_id=b316d727f2304b7cb1437bd4e42030b7, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.271474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b31b4a-629b-44aa-8e69-5611410a9484 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.272526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.276769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3410a7b-5d74-4f86-989b-3bbc429623c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.277368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3410a7b-5d74-4f86-989b-3bbc429623c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.277768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3410a7b-5d74-4f86-989b-3bbc429623c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.278083 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3410a7b-5d74-4f86-989b-3bbc429623c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.278785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3410a7b-5d74-4f86-989b-3bbc429623c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.280750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3410a7b-5d74-4f86-989b-3bbc429623c3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.283651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1013/2001] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:22 2022] PUT /identity/v3/projects/49bfe6acf6d0438b8a8b8fec6da23085/users/b316d727f2304b7cb1437bd4e42030b7/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:22.284526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.323103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 989/2002] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:22 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:22.323103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29d52-6404-4f06-aa83-a8b6a7d2100f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.323103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29d52-6404-4f06-aa83-a8b6a7d2100f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.323103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29d52-6404-4f06-aa83-a8b6a7d2100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.353708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-15e29d52-6404-4f06-aa83-a8b6a7d2100f None None] MFA Rules not processed for user `b316d727f2304b7cb1437bd4e42030b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:22.354961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-15e29d52-6404-4f06-aa83-a8b6a7d2100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.359089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f76c54-8955-4e68-9e73-7477765116b2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.419639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:22.420416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:22.436759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.437473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.437947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.438960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] PATH_INFO: `/v3/users/11ec91bbf26748adbd36513253a2b0fd` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.440209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ec91bbf26748adbd36513253a2b0fd)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.442887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.444119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 990/2003] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:22.444799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29d52-6404-4f06-aa83-a8b6a7d2100f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.457440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29d52-6404-4f06-aa83-a8b6a7d2100f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.462769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.463371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.463993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.464265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.464882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.467663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.491556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 991/2004] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:22 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:22.495814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.520515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ec91bbf26748adbd36513253a2b0fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.521855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ec91bbf26748adbd36513253a2b0fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.540800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ec91bbf26748adbd36513253a2b0fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.542295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ec91bbf26748adbd36513253a2b0fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.555176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ec91bbf26748adbd36513253a2b0fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:22.570654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1d4d-606b-47a5-a0e8-bd392f29b03b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.574033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1014/2005] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:22 2022] DELETE /identity/v3/users/11ec91bbf26748adbd36513253a2b0fd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:22.575710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.577096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.579168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaa9f2-a2f4-401c-90ae-7e48a8785519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.579900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa9f2-a2f4-401c-90ae-7e48a8785519 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.580251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa9f2-a2f4-401c-90ae-7e48a8785519 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.580727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa9f2-a2f4-401c-90ae-7e48a8785519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.582851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dfeaa9f2-a2f4-401c-90ae-7e48a8785519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.597850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaa9f2-a2f4-401c-90ae-7e48a8785519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.599383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaa9f2-a2f4-401c-90ae-7e48a8785519 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.613511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 992/2006] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:22.614855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.615144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.615448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.650707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:22.652253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.660841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 993/2007] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:22.665565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a5901-8fb1-46c0-b990-5870d871c9d1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.673062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.673610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.673726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.673964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.674238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.675025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.675766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.676672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.691661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1015/2008] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:22.699619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.715560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96335f9f-9719-4f31-b7f7-4c3d03762b04 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.745930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.747088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.747370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.747680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.748331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.749928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.751591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f95942-8d54-49e5-8d36-44a01d05c416 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.756159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.756775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.757040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.757469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.760552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1016/2009] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:22.761707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.764476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.773790 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.775645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.786474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 994/2010] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:22.787392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:22.798109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4e0f6-9dda-4ac6-a464-c5ca987e0a87 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.803911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd9e2-c59d-458e-a928-5e3d8fea0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.804844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd9e2-c59d-458e-a928-5e3d8fea0e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.805225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd9e2-c59d-458e-a928-5e3d8fea0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.805598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd9e2-c59d-458e-a928-5e3d8fea0e63 admin admin] PATH_INFO: `/v3/projects/86f6a99680c54fc080f20423dc8f1ec5/users/cb5b686523e748f7b85331261fc25ea5/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.829250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd9e2-c59d-458e-a928-5e3d8fea0e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f6a99680c54fc080f20423dc8f1ec5, user_id=cb5b686523e748f7b85331261fc25ea5, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.833724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd9e2-c59d-458e-a928-5e3d8fea0e63 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.839155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997f8f5-f828-47a3-99db-4af8da36efa8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:22.843695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:22.844502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.844758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.845054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.847331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.854327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:22.858092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 995/2011] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:22 2022] PUT /identity/v3/projects/86f6a99680c54fc080f20423dc8f1ec5/users/cb5b686523e748f7b85331261fc25ea5/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:22.869700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:22.870194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:22.870568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:22.911736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] MFA Rules not processed for user `cb5b686523e748f7b85331261fc25ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:22.913092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:22.952968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:22.954623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:22.956831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:22.967101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1017/2012] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:23.005080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 996/2013] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:23.009342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.042878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb606d44-4528-46cd-a990-b1a870dbebac service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.122612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.124213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.150766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.151639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.152002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.152373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.154061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.156194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.206366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1018/2014] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:23.208037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.210954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03ec86-1e04-4c36-b214-8fd249cf6227 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.304974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338fa8-a094-48e8-a155-0d9fd05c13c9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.310643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.311646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.312256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.312622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.313759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.316043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.324096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.325086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.325498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.325964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] PATH_INFO: `/v3/users/5d828d9defc64d8cb97ff8c44d9cd535` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.328005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d828d9defc64d8cb97ff8c44d9cd535)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.329950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.345469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1019/2015] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:23.346736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.349007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.365857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a24bb-7a67-4e98-9883-da188a14a0cb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.371441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.372435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.372935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.373319 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] PATH_INFO: `/v3/projects/1a99ea24b756405eab84b15b6fa867d5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.385879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a99ea24b756405eab84b15b6fa867d5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.390565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.403760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d828d9defc64d8cb97ff8c44d9cd535'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.419249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:23.420583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d828d9defc64d8cb97ff8c44d9cd535'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.431720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d828d9defc64d8cb97ff8c44d9cd535'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.433290 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d828d9defc64d8cb97ff8c44d9cd535'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.434410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d828d9defc64d8cb97ff8c44d9cd535'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.459341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 997/2016] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:23 2022] DELETE /identity/v3/users/5d828d9defc64d8cb97ff8c44d9cd535 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:23.459341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.460824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.468087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:23.488737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a99ea24b756405eab84b15b6fa867d5', 'request_id': 'req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.502577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a99ea24b756405eab84b15b6fa867d5', 'request_id': 'req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.515610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a99ea24b756405eab84b15b6fa867d5', 'request_id': 'req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.538616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] The token cache is being invalidate because project 1a99ea24b756405eab84b15b6fa867d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:23.538919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.541387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6bbb0d35-70a3-4f0d-a857-455b98fb3f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:23.544783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1020/2017] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:23 2022] DELETE /identity/v3/projects/1a99ea24b756405eab84b15b6fa867d5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:23.550338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b273cf0-d23d-4ef1-99a7-818f2ac3e3d8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.550639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b273cf0-d23d-4ef1-99a7-818f2ac3e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.550922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b273cf0-d23d-4ef1-99a7-818f2ac3e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.592135 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9b273cf0-d23d-4ef1-99a7-818f2ac3e3d8 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:23.594675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9b273cf0-d23d-4ef1-99a7-818f2ac3e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.610198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1021/2018] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:23.611553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.611894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.612155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.632959 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181b47d-17ca-4a63-8053-d54233b53e9f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.645254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.645969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.646564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.646564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.647469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.652418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.668534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:23.669893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.679326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 998/2019] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:23.682595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.692991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1022/2020] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:23.693207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.693428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.700180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.724758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4225ce8-19c2-4a52-998b-7d51b0fb39c3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.745815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98db731-16f3-4cd5-8517-19fd49046d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.746878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98db731-16f3-4cd5-8517-19fd49046d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.747251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98db731-16f3-4cd5-8517-19fd49046d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.747591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98db731-16f3-4cd5-8517-19fd49046d96 admin admin] PATH_INFO: `/v3/projects/a91f419d3b504dc38f818b44eddd5ef4/users/495beb65d03748a7a6e9e6019259bd31/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.779075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98db731-16f3-4cd5-8517-19fd49046d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91f419d3b504dc38f818b44eddd5ef4, user_id=495beb65d03748a7a6e9e6019259bd31, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:23.785581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98db731-16f3-4cd5-8517-19fd49046d96 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:23.808358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1023/2021] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:23 2022] PUT /identity/v3/projects/a91f419d3b504dc38f818b44eddd5ef4/users/495beb65d03748a7a6e9e6019259bd31/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:23.808358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c28c17-4b43-4e4c-a4f2-34f1fc90dc07 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.808358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c28c17-4b43-4e4c-a4f2-34f1fc90dc07 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.808358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c28c17-4b43-4e4c-a4f2-34f1fc90dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.815291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a132f1-1683-49c1-bced-842ed1841171 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:23.853738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f3c28c17-4b43-4e4c-a4f2-34f1fc90dc07 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:23.857398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f3c28c17-4b43-4e4c-a4f2-34f1fc90dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:23.923291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:23.924200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:23.924498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:23.924825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:23.976965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1024/2022] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:23.977953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c28c17-4b43-4e4c-a4f2-34f1fc90dc07 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:23.989331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c28c17-4b43-4e4c-a4f2-34f1fc90dc07 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.001181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.002545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.002865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.003107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.003789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.005545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.018268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.019123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1025/2023] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:24.020188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.020511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.033978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e0343-b731-4f91-afc8-8628b977e215 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.034180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 999/2024] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:24.035032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.042426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:24.048675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.049418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.049794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.050096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.050975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:24.051347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.052607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed7b-be78-4339-be2e-a59155f26309 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.053203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.065132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a928-dc49-4619-b239-88c9c3c3243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.065830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a928-dc49-4619-b239-88c9c3c3243d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.066111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a928-dc49-4619-b239-88c9c3c3243d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.066394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a928-dc49-4619-b239-88c9c3c3243d admin admin] PATH_INFO: `/v3/projects/a91f419d3b504dc38f818b44eddd5ef4/users/495beb65d03748a7a6e9e6019259bd31/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.070753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1026/2025] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:24.072256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a928-dc49-4619-b239-88c9c3c3243d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91f419d3b504dc38f818b44eddd5ef4, user_id=495beb65d03748a7a6e9e6019259bd31, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.081826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a928-dc49-4619-b239-88c9c3c3243d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.085427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.094903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1000/2026] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:24 2022] PUT /identity/v3/projects/a91f419d3b504dc38f818b44eddd5ef4/users/495beb65d03748a7a6e9e6019259bd31/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:24.099803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35b014-59ff-412e-8abd-7e2be1641be9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.107479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aef27-0ddd-48be-a842-72829535c33d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.107907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aef27-0ddd-48be-a842-72829535c33d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.108292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aef27-0ddd-48be-a842-72829535c33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.149638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-130aef27-0ddd-48be-a842-72829535c33d None None] MFA Rules not processed for user `495beb65d03748a7a6e9e6019259bd31`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:24.151967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-130aef27-0ddd-48be-a842-72829535c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:24.161863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:24.186761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.187926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.188545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.189076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.189894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.192421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.238491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1027/2027] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:24 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:24.242668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.305787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1001/2028] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:24.327824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aef27-0ddd-48be-a842-72829535c33d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.331030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-130aef27-0ddd-48be-a842-72829535c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:24.425133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4895bf-c0e7-4e90-8e5e-6cc36ee8aa3c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.434858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.435613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.435895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.436179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.436856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.442249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.480235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1028/2029] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:24 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:24.483499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.499476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aef27-0ddd-48be-a842-72829535c33d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.504142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d469e7-683b-45c4-90f8-1ac3309c4c41 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.511069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.512929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.513285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.513630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.514359 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.521373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.556983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1029/2030] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:24.563775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.585935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f29ed5-0e96-49b1-bc07-43e8fb18ac9b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.586918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.587779 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.588031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.588278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.590239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:24.600726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.601316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.601694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.602846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.603602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.613968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.634789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1030/2031] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:24.636077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.638964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:24.658535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78db07-c3a2-433e-a24c-42d77a680d7f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.664659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.665481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:24.665993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.666300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.666890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] PATH_INFO: `/v3/projects/3b4015c63b0f4493b67b5a86328559c9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.668898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4015c63b0f4493b67b5a86328559c9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.672900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.682790 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.685598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.715149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1002/2032] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:24.717262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:24.739559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4015c63b0f4493b67b5a86328559c9', 'request_id': 'req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:24.742997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769536bf-64f8-4488-9c35-953d9f358105 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:24.749265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4015c63b0f4493b67b5a86328559c9', 'request_id': 'req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:24.756471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4015c63b0f4493b67b5a86328559c9', 'request_id': 'req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:24.792708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] The token cache is being invalidate because project 3b4015c63b0f4493b67b5a86328559c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:24.793144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:24.799976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d8f1ce9-5af7-4c13-b6be-8b740cf2f58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:24.801967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1031/2033] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:24 2022] DELETE /identity/v3/projects/3b4015c63b0f4493b67b5a86328559c9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:24.807888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ce03-487b-49c3-a145-cf768204c83e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.808204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ce03-487b-49c3-a145-cf768204c83e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.808442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149ce03-487b-49c3-a145-cf768204c83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.835979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4149ce03-487b-49c3-a145-cf768204c83e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:24.837776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4149ce03-487b-49c3-a145-cf768204c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:24.856489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:24.858872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548d97e-6367-4c4e-95ed-cc86951ea663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:24.859912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d97e-6367-4c4e-95ed-cc86951ea663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.860205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d97e-6367-4c4e-95ed-cc86951ea663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.860479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d97e-6367-4c4e-95ed-cc86951ea663 admin admin] PATH_INFO: `/v3/projects/c6de8825fdad49bbb1c7a81074f6f0f0/users/72a9a353d5f5436caf4620b31a70ecf0/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.881892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548d97e-6367-4c4e-95ed-cc86951ea663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6de8825fdad49bbb1c7a81074f6f0f0, user_id=72a9a353d5f5436caf4620b31a70ecf0, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:24.885482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548d97e-6367-4c4e-95ed-cc86951ea663 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:24.908296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1003/2034] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:24 2022] PUT /identity/v3/projects/c6de8825fdad49bbb1c7a81074f6f0f0/users/72a9a353d5f5436caf4620b31a70ecf0/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:24.922697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199dad6-5cb9-44a6-9979-d91cb98f0f41 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.922911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199dad6-5cb9-44a6-9979-d91cb98f0f41 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.923166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199dad6-5cb9-44a6-9979-d91cb98f0f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.947136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1032/2035] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:24.955877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303bb9-c3b1-4668-aa08-3621f2b42e41 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:24.956696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303bb9-c3b1-4668-aa08-3621f2b42e41 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:24.957193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303bb9-c3b1-4668-aa08-3621f2b42e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:24.971891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e199dad6-5cb9-44a6-9979-d91cb98f0f41 None None] MFA Rules not processed for user `72a9a353d5f5436caf4620b31a70ecf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:24.972950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e199dad6-5cb9-44a6-9979-d91cb98f0f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:24.987031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2c303bb9-c3b1-4668-aa08-3621f2b42e41 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:24.988496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2c303bb9-c3b1-4668-aa08-3621f2b42e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:25.075565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1004/2036] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:25.079455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1033/2037] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:25.083718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199dad6-5cb9-44a6-9979-d91cb98f0f41 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.098407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199dad6-5cb9-44a6-9979-d91cb98f0f41 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.104143 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.105491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.106515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.106990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.107927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:25.108522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.110414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.131215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1005/2038] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:11:25.137083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303bb9-c3b1-4668-aa08-3621f2b42e41 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.154449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303bb9-c3b1-4668-aa08-3621f2b42e41 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.164210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.166395 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.166889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.167267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.168809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.170989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.173476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.178116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:25.220921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1034/2039] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:25 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:25.227973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.280340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:25.286772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd894d0-d42e-4665-9537-ff4879916d8a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.342971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0480f-79cb-4814-b876-954601576066 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.350300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.350924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.351192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.351481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.352402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.358092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.358581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.359607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.360026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.360395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.383478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1035/2040] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:25 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:25.386499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.400145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50867bb-ae32-45ad-be70-cd23ed98387f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.411014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.412222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.412653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.413071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.415107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.416963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.434715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1036/2041] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:25.437544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.439396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.439665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.451726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1006/2042] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:25.464002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe475-787a-4d9c-87c3-07218056c93a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.471765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbe749-55e1-4c79-9c2c-301b99f27a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.472520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbe749-55e1-4c79-9c2c-301b99f27a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.472892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbe749-55e1-4c79-9c2c-301b99f27a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.473232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbe749-55e1-4c79-9c2c-301b99f27a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.474005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbe749-55e1-4c79-9c2c-301b99f27a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.475773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbe749-55e1-4c79-9c2c-301b99f27a65 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.491853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1037/2043] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:25.493256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.508860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16acf0-127b-4a96-8882-d6c646a804a0 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.518104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.518872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.519246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.519863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] PATH_INFO: `/v3/projects/f4b13c8e17aa4627b5f2d76e7388865a/users/52d24256e4534136bd80ad6f969d44a2/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.540703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b13c8e17aa4627b5f2d76e7388865a, user_id=52d24256e4534136bd80ad6f969d44a2, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.544601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.583934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1007/2044] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:25 2022] PUT /identity/v3/projects/f4b13c8e17aa4627b5f2d76e7388865a/users/52d24256e4534136bd80ad6f969d44a2/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:25.585029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.585312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.585579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.615934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:25.634255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] MFA Rules not processed for user `52d24256e4534136bd80ad6f969d44a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:25.636443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:25.778048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1038/2045] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:25.801693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:25.897969 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2ad6-9457-4733-bb07-e6b1ec4548df admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:25.902811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:25.903562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:25.904047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:25.904302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:25.915130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:25.916500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:25.927720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1008/2046] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:26.874007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:26.876653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:26.897408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:26.899435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:26.912306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ed9e5-eae0-46f6-8d8e-5ea13955b132 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:26.917380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6acfc-5aa8-4a9d-ac4e-6cb0897fbed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:26.918013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6acfc-5aa8-4a9d-ac4e-6cb0897fbed0 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:26.918840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6acfc-5aa8-4a9d-ac4e-6cb0897fbed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:26.919124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6acfc-5aa8-4a9d-ac4e-6cb0897fbed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:26.921223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-97f6acfc-5aa8-4a9d-ac4e-6cb0897fbed0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:26.957415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:26.983040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c56cda-ad08-435b-969a-8d109aeb8ed4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:26.987812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6acfc-5aa8-4a9d-ac4e-6cb0897fbed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:26.989364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6acfc-5aa8-4a9d-ac4e-6cb0897fbed0 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:26.989775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:26.990486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:26.990895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:26.991234 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] PATH_INFO: `/v3/users/9864d2d2a6a943f386c6775068933e40` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:26.992547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9864d2d2a6a943f386c6775068933e40)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:26.996066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:26.999738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1009/2047] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:11:27.061168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9864d2d2a6a943f386c6775068933e40'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:27.062138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9864d2d2a6a943f386c6775068933e40'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:27.084939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9864d2d2a6a943f386c6775068933e40'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:27.085681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9864d2d2a6a943f386c6775068933e40'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:27.094942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9864d2d2a6a943f386c6775068933e40'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:27.118497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1039/2048] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:26 2022] DELETE /identity/v3/users/9864d2d2a6a943f386c6775068933e40 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:27.120203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38c1b-bad6-451a-bad6-5327070064a6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:27.120487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38c1b-bad6-451a-bad6-5327070064a6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:27.120763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38c1b-bad6-451a-bad6-5327070064a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:27.143162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-94d38c1b-bad6-451a-bad6-5327070064a6 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:27.144966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-94d38c1b-bad6-451a-bad6-5327070064a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:27.221440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1010/2049] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:27.232050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:27.233602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:27.281698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:27.362097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104639df-bc52-456e-b57c-0e680847faa8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:27.366670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:27.367547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:27.368039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:27.368573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:27.381753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:27.383592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:27.397099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1040/2050] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:27.567172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:27.567745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:27.568120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:27.595916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] MFA Rules not processed for user `52d24256e4534136bd80ad6f969d44a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:27.597963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:27.682252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1011/2051] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:27.840987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:27.843003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:27.937148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84120e1a-966d-4ce0-a2e3-41fe27073856 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:27.951507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:27.952155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:27.952427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:27.952700 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:27.958492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:28.118513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:28.120333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:28.140546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1041/2052] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:28.224882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:28.225968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:28.263269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d44c-470d-42c9-8ead-4583cb6ece8c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:28.270052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:28.270788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:28.271201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:28.271643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] PATH_INFO: `/v3/projects/49e3109629cd497ba44e443c98dee358` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:28.273461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e3109629cd497ba44e443c98dee358)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:28.275050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:28.358976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e3109629cd497ba44e443c98dee358', 'request_id': 'req-9276b078-b423-4d51-8253-ea4014d39e0f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.378183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e3109629cd497ba44e443c98dee358', 'request_id': 'req-9276b078-b423-4d51-8253-ea4014d39e0f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.385451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e3109629cd497ba44e443c98dee358', 'request_id': 'req-9276b078-b423-4d51-8253-ea4014d39e0f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.401619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] The token cache is being invalidate because project 49e3109629cd497ba44e443c98dee358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:28.401988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.403519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.405575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1012/2053] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:28 2022] DELETE /identity/v3/projects/49e3109629cd497ba44e443c98dee358 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:28.412656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:28.426328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f7331-eab6-414c-9471-49df0e4c4ebc service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:28.501175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:28.501956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:28.502297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:28.502636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] PATH_INFO: `/v3/users/b316d727f2304b7cb1437bd4e42030b7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:28.504580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b316d727f2304b7cb1437bd4e42030b7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:28.506954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:28.519687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:28.567207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b316d727f2304b7cb1437bd4e42030b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.568176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b316d727f2304b7cb1437bd4e42030b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.587851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b316d727f2304b7cb1437bd4e42030b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.589632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b316d727f2304b7cb1437bd4e42030b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.601489 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-923c4ea4-1631-4b08-9575-1c1a84d5a9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b316d727f2304b7cb1437bd4e42030b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:28.633076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1042/2054] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:28 2022] DELETE /identity/v3/users/b316d727f2304b7cb1437bd4e42030b7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:28.952844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:28.954337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:28.963638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:28.971153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b078-b423-4d51-8253-ea4014d39e0f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.041849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.042703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.043044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.044161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] PATH_INFO: `/v3/projects/49bfe6acf6d0438b8a8b8fec6da23085` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.045684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bfe6acf6d0438b8a8b8fec6da23085)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.047911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.099537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bfe6acf6d0438b8a8b8fec6da23085', 'request_id': 'req-858b1d28-db4e-4883-bced-8a303f18a489'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:29.109358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bfe6acf6d0438b8a8b8fec6da23085', 'request_id': 'req-858b1d28-db4e-4883-bced-8a303f18a489'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:29.116486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bfe6acf6d0438b8a8b8fec6da23085', 'request_id': 'req-858b1d28-db4e-4883-bced-8a303f18a489'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:29.129468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] The token cache is being invalidate because project 49bfe6acf6d0438b8a8b8fec6da23085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:29.129776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:29.130449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-858b1d28-db4e-4883-bced-8a303f18a489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:29.132240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1013/2055] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:28 2022] DELETE /identity/v3/projects/49bfe6acf6d0438b8a8b8fec6da23085 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:29.137167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74f7f5-a750-4d29-90f0-3694d27443f1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.138048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74f7f5-a750-4d29-90f0-3694d27443f1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.138320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74f7f5-a750-4d29-90f0-3694d27443f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.175768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0d74f7f5-a750-4d29-90f0-3694d27443f1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:29.176997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0d74f7f5-a750-4d29-90f0-3694d27443f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:29.258438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1043/2056] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:29.268238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a9ac-1ce7-45ba-9d8a-9a9fcf174df2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.269179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a9ac-1ce7-45ba-9d8a-9a9fcf174df2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.269938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a9ac-1ce7-45ba-9d8a-9a9fcf174df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.297402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c262a9ac-1ce7-45ba-9d8a-9a9fcf174df2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:29.299173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c262a9ac-1ce7-45ba-9d8a-9a9fcf174df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:29.308004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1014/2057] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:29.314327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74f7f5-a750-4d29-90f0-3694d27443f1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.326249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74f7f5-a750-4d29-90f0-3694d27443f1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.331566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.332186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.332468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.332735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.333382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:29.333681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.335434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.350249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1044/2058] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:29.354581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262a9ac-1ce7-45ba-9d8a-9a9fcf174df2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.369595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262a9ac-1ce7-45ba-9d8a-9a9fcf174df2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.370215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.370814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.371087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.371382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.372093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.374848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.413781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1015/2059] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:29.414824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.426448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735215d-8c28-4cf6-963b-b032c8a096ad admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.494660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.495275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.495601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.495872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.496549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.500171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.532350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1045/2060] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:29.537578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.554503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c34cc-05cd-4619-a3b9-def359b09a02 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.561544 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.562299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.562580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.562859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.563802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.565486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.579465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1016/2061] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:29.583083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.590109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:29.595495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522c67-852a-4570-ace3-f607606c4c55 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.602485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c8b76-4695-4a99-9b73-becc0ffc314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.603306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8b76-4695-4a99-9b73-becc0ffc314b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.603943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8b76-4695-4a99-9b73-becc0ffc314b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.604522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c8b76-4695-4a99-9b73-becc0ffc314b admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.605476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8b76-4695-4a99-9b73-becc0ffc314b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.607961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c8b76-4695-4a99-9b73-becc0ffc314b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.623375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1046/2062] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:29.624665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.635096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfe0c1-a4f0-4d25-9c71-25df908915b3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.642271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.643141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.643482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.643771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] PATH_INFO: `/v3/projects/7b303173c1bd466fb54ae2601e965d1d/users/7655a8b71dc240069518aabb4ac4fcb8/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.665115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b303173c1bd466fb54ae2601e965d1d, user_id=7655a8b71dc240069518aabb4ac4fcb8, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.667846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.683449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1017/2063] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:29 2022] PUT /identity/v3/projects/7b303173c1bd466fb54ae2601e965d1d/users/7655a8b71dc240069518aabb4ac4fcb8/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:29.692947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d18e-575e-420b-bfd6-2bb69c998ee0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.693235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d18e-575e-420b-bfd6-2bb69c998ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.693508 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d18e-575e-420b-bfd6-2bb69c998ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.723697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8436d18e-575e-420b-bfd6-2bb69c998ee0 None None] MFA Rules not processed for user `7655a8b71dc240069518aabb4ac4fcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:29.725016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8436d18e-575e-420b-bfd6-2bb69c998ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:29.790673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1047/2064] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:29.794723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.827486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:29.860822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80601fdb-2193-4319-9dc2-09cb4ebcaa23 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.865463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.866065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.866340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.866609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.867224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.869185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:29.894981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1018/2065] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:29.899150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d18e-575e-420b-bfd6-2bb69c998ee0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:29.910811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d18e-575e-420b-bfd6-2bb69c998ee0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:29.973093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:29.973631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:29.973914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:29.974191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:29.974835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:29.976802 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.002507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1048/2066] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:29 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:30.004712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:30.016121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b470f-2395-47a3-ace4-a159bf9740b9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:30.021136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:30.021730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.022000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.022267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.022930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:30.024545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.038454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1019/2067] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:30.039867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:30.050525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19642-a012-4bdf-bca1-7f6091b4a9fa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:30.055117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:30.055791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.056063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.056358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] PATH_INFO: `/v3/projects/af991744923c4cec88208994ba3b6ebe/users/bd2e60abae8b4e62a5c9571f17f8313c/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.071905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af991744923c4cec88208994ba3b6ebe, user_id=bd2e60abae8b4e62a5c9571f17f8313c, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:30.075232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.088042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1049/2068] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:30 2022] PUT /identity/v3/projects/af991744923c4cec88208994ba3b6ebe/users/bd2e60abae8b4e62a5c9571f17f8313c/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:30.092728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:30.102991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54770b-b580-4e1e-bba1-6ebd162d3921 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:30.159662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264b8a0-680c-4593-a003-654bd1fc0aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:30.160267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264b8a0-680c-4593-a003-654bd1fc0aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.160546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264b8a0-680c-4593-a003-654bd1fc0aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.160818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264b8a0-680c-4593-a003-654bd1fc0aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.161483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264b8a0-680c-4593-a003-654bd1fc0aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:30.163082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264b8a0-680c-4593-a003-654bd1fc0aa1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.173136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1020/2069] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:30.177455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:30.187674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71fe81-a740-4b68-befd-9f9b80ae8b24 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:30.192461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:30.193117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.193390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.193655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] PATH_INFO: `/v3/projects/af991744923c4cec88208994ba3b6ebe/users/bd2e60abae8b4e62a5c9571f17f8313c/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.195605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af991744923c4cec88208994ba3b6ebe, user_id=bd2e60abae8b4e62a5c9571f17f8313c, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:30.198223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.208403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1050/2070] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:30 2022] PUT /identity/v3/projects/af991744923c4cec88208994ba3b6ebe/users/bd2e60abae8b4e62a5c9571f17f8313c/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:30.219859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ad16-afcf-4b55-beff-dfd3e20a8584 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.220144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ad16-afcf-4b55-beff-dfd3e20a8584 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.220419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ad16-afcf-4b55-beff-dfd3e20a8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.250292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c0a7ad16-afcf-4b55-beff-dfd3e20a8584 None None] MFA Rules not processed for user `bd2e60abae8b4e62a5c9571f17f8313c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:30.251552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c0a7ad16-afcf-4b55-beff-dfd3e20a8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:30.319763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1021/2071] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:30.331752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:30.333524 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:30.380133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:30.401204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce8d1-be68-47a3-b14a-45fd5861579e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:30.406719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c006b-3c59-4940-9808-a951d53132d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:30.407397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c006b-3c59-4940-9808-a951d53132d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.407767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c006b-3c59-4940-9808-a951d53132d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.408099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c006b-3c59-4940-9808-a951d53132d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.420888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c006b-3c59-4940-9808-a951d53132d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:30.420888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c006b-3c59-4940-9808-a951d53132d9 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.430827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1051/2072] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:30.570115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ad16-afcf-4b55-beff-dfd3e20a8584 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:30.598976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:30.638390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ad16-afcf-4b55-beff-dfd3e20a8584 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:30.642973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:30.643639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.644954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.644954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] PATH_INFO: `/v3/users/7655a8b71dc240069518aabb4ac4fcb8` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.645592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7655a8b71dc240069518aabb4ac4fcb8)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:30.647550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.717065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7655a8b71dc240069518aabb4ac4fcb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:30.730006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7655a8b71dc240069518aabb4ac4fcb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:30.737060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7655a8b71dc240069518aabb4ac4fcb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:30.737781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7655a8b71dc240069518aabb4ac4fcb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:30.738383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7655a8b71dc240069518aabb4ac4fcb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:30.755951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1022/2073] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:30 2022] DELETE /identity/v3/users/7655a8b71dc240069518aabb4ac4fcb8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:30.760553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.760834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.761099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.780951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:30.782270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:30.840336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1052/2074] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:30.850085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:30.851720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:30.925333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addff79-6fba-4df1-b772-2aa75c7e5ca5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:30.929025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:30.929626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:30.929904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:30.930177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:30.939973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:30.941730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:30.951832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1023/2075] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:31.250991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:31.252870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:31.271696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4fd8d-25dd-4c3b-ab17-b3b90935ed7e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:31.277300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:31.279965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:31.280244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:31.280887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] PATH_INFO: `/v3/projects/7b303173c1bd466fb54ae2601e965d1d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:31.282041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b303173c1bd466fb54ae2601e965d1d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:31.284018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:31.343605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b303173c1bd466fb54ae2601e965d1d', 'request_id': 'req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.350218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b303173c1bd466fb54ae2601e965d1d', 'request_id': 'req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.356808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b303173c1bd466fb54ae2601e965d1d', 'request_id': 'req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.372838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] The token cache is being invalidate because project 7b303173c1bd466fb54ae2601e965d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:31.373080 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.373705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.375274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1053/2076] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:31 2022] DELETE /identity/v3/projects/7b303173c1bd466fb54ae2601e965d1d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:31.379830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:31.390103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f589e7-f4c5-4435-92f0-6620846ef26b service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:31.436681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:31.457032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:31.457737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:31.458052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:31.458332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] PATH_INFO: `/v3/users/bd2e60abae8b4e62a5c9571f17f8313c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:31.459683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2e60abae8b4e62a5c9571f17f8313c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:31.461976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:31.520833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2e60abae8b4e62a5c9571f17f8313c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.535649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2e60abae8b4e62a5c9571f17f8313c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.545982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2e60abae8b4e62a5c9571f17f8313c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.547015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2e60abae8b4e62a5c9571f17f8313c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.547670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-651ddb85-d0d7-4b08-a0dd-70c05492de92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2e60abae8b4e62a5c9571f17f8313c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:31.566125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1024/2077] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:31 2022] DELETE /identity/v3/users/bd2e60abae8b4e62a5c9571f17f8313c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:31.963440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:31.965063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.002735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbf021-e3ee-468a-b783-c67ad2bf88f4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.094079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.094646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.094926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.095253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] PATH_INFO: `/v3/projects/af991744923c4cec88208994ba3b6ebe` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.097346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af991744923c4cec88208994ba3b6ebe)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.098956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.102014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:32.156474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af991744923c4cec88208994ba3b6ebe', 'request_id': 'req-5e2677cb-1198-4a08-a203-79efe8eb78b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.162666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af991744923c4cec88208994ba3b6ebe', 'request_id': 'req-5e2677cb-1198-4a08-a203-79efe8eb78b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.168638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af991744923c4cec88208994ba3b6ebe', 'request_id': 'req-5e2677cb-1198-4a08-a203-79efe8eb78b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.181793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] The token cache is being invalidate because project af991744923c4cec88208994ba3b6ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:32.182181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.182898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e2677cb-1198-4a08-a203-79efe8eb78b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:32.185391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1054/2078] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:31 2022] DELETE /identity/v3/projects/af991744923c4cec88208994ba3b6ebe => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:32.191664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d942b-4185-4100-869e-8edafa752429 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.191949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d942b-4185-4100-869e-8edafa752429 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.192226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d942b-4185-4100-869e-8edafa752429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.212584 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f53d942b-4185-4100-869e-8edafa752429 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:32.213807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f53d942b-4185-4100-869e-8edafa752429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.276565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1025/2079] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:32.284617 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b104-7576-4c37-85c8-49067acf33db None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.285175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b104-7576-4c37-85c8-49067acf33db None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.285289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b104-7576-4c37-85c8-49067acf33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.308501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-af44b104-7576-4c37-85c8-49067acf33db None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:32.310420 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-af44b104-7576-4c37-85c8-49067acf33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.318706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1055/2080] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:32.323215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d942b-4185-4100-869e-8edafa752429 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.334276 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d942b-4185-4100-869e-8edafa752429 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.338897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.339546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.339856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.340173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.341072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:32.341366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.342990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.355864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1026/2081] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:11:32.360369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44b104-7576-4c37-85c8-49067acf33db None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.370705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44b104-7576-4c37-85c8-49067acf33db None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.375953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.376554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.376827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.377092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.377716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.379643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.410007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1056/2082] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:32.414424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.424676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818cd20-2f8b-4018-8ecf-b0e74a47b2bb admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.478256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:32.489191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.489888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.490267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.490545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.491225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.493273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.516590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1027/2083] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:32.520753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.531540 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b192a-f69f-4eb6-b715-eaf62dcf6a8b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.536979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.537662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.538018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.538354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.539054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.540669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.552740 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1057/2084] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:32.556762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.568554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e613-aa9b-49bb-8a4f-97dede031243 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.573217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f5e6-4e19-471a-9eaa-025a2e553e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.573813 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f5e6-4e19-471a-9eaa-025a2e553e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.574084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f5e6-4e19-471a-9eaa-025a2e553e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.574388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f5e6-4e19-471a-9eaa-025a2e553e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.575014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f5e6-4e19-471a-9eaa-025a2e553e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.576638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f5e6-4e19-471a-9eaa-025a2e553e3d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.591162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1028/2085] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:32.592588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.602835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6cd85-88d3-4742-ad92-79602f23748a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.608584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.609253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.609531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.609804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] PATH_INFO: `/v3/projects/9a43054886c3453582e0e5255d0878b9/users/63256ea7f9a541ff9256a6770b191ec3/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.625868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a43054886c3453582e0e5255d0878b9, user_id=63256ea7f9a541ff9256a6770b191ec3, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.628607 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.643650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1058/2086] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:32 2022] PUT /identity/v3/projects/9a43054886c3453582e0e5255d0878b9/users/63256ea7f9a541ff9256a6770b191ec3/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:32.654362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.654645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.654915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.683107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] MFA Rules not processed for user `63256ea7f9a541ff9256a6770b191ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:32.685194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.765096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1029/2087] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:32.776264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:32.778001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:32.843989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65de0-ce3c-47bc-94c9-c477cdec2d3e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:32.853998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092df66-7131-4ac9-bbdf-89ea353ff271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:32.854970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092df66-7131-4ac9-bbdf-89ea353ff271 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:32.856028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092df66-7131-4ac9-bbdf-89ea353ff271 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:32.856453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092df66-7131-4ac9-bbdf-89ea353ff271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:32.867962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092df66-7131-4ac9-bbdf-89ea353ff271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:32.869398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092df66-7131-4ac9-bbdf-89ea353ff271 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:32.881493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1059/2088] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:34.357225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:34.358737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:34.468250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce512652-1597-49e5-ac02-ac18c176e2fd None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:34.474895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:34.475619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:34.476028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:34.476212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] PATH_INFO: `/v3/users/72a9a353d5f5436caf4620b31a70ecf0` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:34.477418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a9a353d5f5436caf4620b31a70ecf0)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:34.479382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:34.592405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a9a353d5f5436caf4620b31a70ecf0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:34.624088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:34.626123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a9a353d5f5436caf4620b31a70ecf0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:34.649592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a9a353d5f5436caf4620b31a70ecf0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:34.654100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a9a353d5f5436caf4620b31a70ecf0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:34.654828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a9a353d5f5436caf4620b31a70ecf0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:34.676856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1030/2089] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:34 2022] DELETE /identity/v3/users/72a9a353d5f5436caf4620b31a70ecf0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:34.681234 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:34.682120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:34.682695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:34.715381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:34.719125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:34.774708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:34.835164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1060/2090] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:34.847612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:34.848980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:34.948612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17303e50-bbeb-42f0-b6da-4af17d8d2fa0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:34.953397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:34.954281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:34.954695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:34.955062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:34.964736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:34.966515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:34.977213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1031/2091] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:35.333011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:35.334673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:35.354470 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070b35-bb2a-49af-b719-b223e218fdfc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:35.360892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:35.361721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:35.362150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:35.362560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] PATH_INFO: `/v3/projects/c6de8825fdad49bbb1c7a81074f6f0f0` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:35.364014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6de8825fdad49bbb1c7a81074f6f0f0)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:35.367798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:35.459446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6de8825fdad49bbb1c7a81074f6f0f0', 'request_id': 'req-2c78bfc2-6ed5-439a-b599-25ab57f50d66'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.469601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6de8825fdad49bbb1c7a81074f6f0f0', 'request_id': 'req-2c78bfc2-6ed5-439a-b599-25ab57f50d66'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.479215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6de8825fdad49bbb1c7a81074f6f0f0', 'request_id': 'req-2c78bfc2-6ed5-439a-b599-25ab57f50d66'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.506737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] The token cache is being invalidate because project c6de8825fdad49bbb1c7a81074f6f0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:35.507104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.508191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c78bfc2-6ed5-439a-b599-25ab57f50d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.520137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1061/2092] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:35 2022] DELETE /identity/v3/projects/c6de8825fdad49bbb1c7a81074f6f0f0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:35.633665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:35.635183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:35.649230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264a05-1a65-4fd7-8d30-355431db39ec service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:35.742146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:35.742768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:35.743210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:35.743709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] PATH_INFO: `/v3/users/ec80cb37c5fc4b4ebecfb550aa3a0dce` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:35.745355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec80cb37c5fc4b4ebecfb550aa3a0dce)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:35.749829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:35.820313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec80cb37c5fc4b4ebecfb550aa3a0dce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.836175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec80cb37c5fc4b4ebecfb550aa3a0dce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.844242 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec80cb37c5fc4b4ebecfb550aa3a0dce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.845099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec80cb37c5fc4b4ebecfb550aa3a0dce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.845758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec80cb37c5fc4b4ebecfb550aa3a0dce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:35.859771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1032/2093] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:35 2022] DELETE /identity/v3/users/ec80cb37c5fc4b4ebecfb550aa3a0dce => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:35.864078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:35.864564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:35.864656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:35.884576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:35.885824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:35.951951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1062/2094] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:35.961750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:35.963365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:35.969432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:36.028457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b2cb2-e88b-48d0-abca-c4e463d6b1c5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:36.032449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:36.033116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:36.033392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:36.033661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:36.043833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:36.045448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:36.055532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1033/2095] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:36.324311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:36.325893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:36.340390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bccdf-1c7b-4d97-8dd5-8d8722c13c31 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:36.345089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:36.345725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:36.346001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:36.346276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] PATH_INFO: `/v3/projects/a99ced433a0e4117b4cdc012f74f542b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:36.347782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99ced433a0e4117b4cdc012f74f542b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:36.349834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:36.396803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99ced433a0e4117b4cdc012f74f542b', 'request_id': 'req-5def879c-2b09-47df-adb7-b2c0fe14d2ed'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.397936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:36.404603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99ced433a0e4117b4cdc012f74f542b', 'request_id': 'req-5def879c-2b09-47df-adb7-b2c0fe14d2ed'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.410990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99ced433a0e4117b4cdc012f74f542b', 'request_id': 'req-5def879c-2b09-47df-adb7-b2c0fe14d2ed'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.424623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] The token cache is being invalidate because project a99ced433a0e4117b4cdc012f74f542b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:36.424916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.425575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.428584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1063/2096] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:36 2022] DELETE /identity/v3/projects/a99ced433a0e4117b4cdc012f74f542b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:36.432579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:36.443652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039f614-df9b-46a8-98a2-6b946b2758b5 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:36.504627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:36.505318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:36.505622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:36.505895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] PATH_INFO: `/v3/users/cb5b686523e748f7b85331261fc25ea5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:36.507097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5b686523e748f7b85331261fc25ea5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:36.509080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:36.566467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5b686523e748f7b85331261fc25ea5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.583933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5b686523e748f7b85331261fc25ea5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.590982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5b686523e748f7b85331261fc25ea5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.591721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5b686523e748f7b85331261fc25ea5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.592355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5b686523e748f7b85331261fc25ea5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:36.611173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1034/2097] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:36 2022] DELETE /identity/v3/users/cb5b686523e748f7b85331261fc25ea5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:36.896081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:36.897666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:36.914632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def879c-2b09-47df-adb7-b2c0fe14d2ed admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:36.978067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:36.978717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:36.978991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:36.979260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] PATH_INFO: `/v3/projects/86f6a99680c54fc080f20423dc8f1ec5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:36.980512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f6a99680c54fc080f20423dc8f1ec5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:36.983248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:37.034072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f6a99680c54fc080f20423dc8f1ec5', 'request_id': 'req-050bcf78-e45d-4f1f-8af5-475b9a28020a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.040446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f6a99680c54fc080f20423dc8f1ec5', 'request_id': 'req-050bcf78-e45d-4f1f-8af5-475b9a28020a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.047349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f6a99680c54fc080f20423dc8f1ec5', 'request_id': 'req-050bcf78-e45d-4f1f-8af5-475b9a28020a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.060841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] The token cache is being invalidate because project 86f6a99680c54fc080f20423dc8f1ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:37.061198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.061826 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.063991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1064/2098] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:36 2022] DELETE /identity/v3/projects/86f6a99680c54fc080f20423dc8f1ec5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:37.067782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:37.069366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:37.083592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd939d29-b047-4fb5-ad75-6a7efedc4457 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:37.104901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:37.152984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:37.153999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:37.154608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:37.155160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] PATH_INFO: `/v3/users/495beb65d03748a7a6e9e6019259bd31` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:37.157273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495beb65d03748a7a6e9e6019259bd31)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:37.160368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:37.221537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495beb65d03748a7a6e9e6019259bd31'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.240056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495beb65d03748a7a6e9e6019259bd31'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.248539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495beb65d03748a7a6e9e6019259bd31'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.249315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495beb65d03748a7a6e9e6019259bd31'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.249950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e0ff1602-ca21-426f-9410-586938dcef45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495beb65d03748a7a6e9e6019259bd31'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.264167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1035/2099] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:37 2022] DELETE /identity/v3/users/495beb65d03748a7a6e9e6019259bd31 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:37.547300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:37.548919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:37.562209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcf78-e45d-4f1f-8af5-475b9a28020a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:37.622744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:37.623379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:37.623687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:37.623965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] PATH_INFO: `/v3/projects/a91f419d3b504dc38f818b44eddd5ef4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:37.625137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91f419d3b504dc38f818b44eddd5ef4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:37.627061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:37.637789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:37.678832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91f419d3b504dc38f818b44eddd5ef4', 'request_id': 'req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.685592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91f419d3b504dc38f818b44eddd5ef4', 'request_id': 'req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.691456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91f419d3b504dc38f818b44eddd5ef4', 'request_id': 'req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.704988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] The token cache is being invalidate because project a91f419d3b504dc38f818b44eddd5ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:37.705273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.705902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-99a5ee38-e31f-40bc-ba1e-cbdfe0eea71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:37.707616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1065/2100] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:37 2022] DELETE /identity/v3/projects/a91f419d3b504dc38f818b44eddd5ef4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:37.713956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00dc15-08f3-47ef-8bbc-143815caa371 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:37.714239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00dc15-08f3-47ef-8bbc-143815caa371 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:37.714513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00dc15-08f3-47ef-8bbc-143815caa371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:37.738525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1e00dc15-08f3-47ef-8bbc-143815caa371 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:37.739819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1e00dc15-08f3-47ef-8bbc-143815caa371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:37.808116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1036/2101] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:37.816690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc10d5-6aea-4759-ba95-f371bb392fe6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:37.816975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc10d5-6aea-4759-ba95-f371bb392fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:37.817343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc10d5-6aea-4759-ba95-f371bb392fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:37.838531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-52dc10d5-6aea-4759-ba95-f371bb392fe6 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:37.840414 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-52dc10d5-6aea-4759-ba95-f371bb392fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:37.849882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1066/2102] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:37.854359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00dc15-08f3-47ef-8bbc-143815caa371 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:37.864958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00dc15-08f3-47ef-8bbc-143815caa371 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:37.869718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:37.870318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:37.870594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:37.870866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:37.871847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:37.872153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:37.873767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:37.887457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1037/2103] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:11:37.892172 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc10d5-6aea-4759-ba95-f371bb392fe6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:37.901492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc10d5-6aea-4759-ba95-f371bb392fe6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:37.906723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:37.907323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:37.907636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:37.907909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:37.908554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:37.910434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:37.937706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1067/2104] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:37 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:37.942133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:37.953185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdb6d1-6687-43e8-b333-441997d46ee4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:37.984038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:38.014408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:38.014938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:38.015216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:38.015523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:38.016151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:38.018066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:38.041261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1038/2105] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:37 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:38.046415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:38.060485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20650496-cc54-468e-810e-974254cabe63 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:38.066980 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:38.067637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:38.068057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:38.068378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:38.069109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:38.071264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:38.086917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1068/2106] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:38.091259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:38.101972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317a158-2ca3-4021-8c88-acf1accdd74d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:38.107546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab485826-6e5e-4f48-ac1f-9033dc9068cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:38.108227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab485826-6e5e-4f48-ac1f-9033dc9068cb admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:38.108626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab485826-6e5e-4f48-ac1f-9033dc9068cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:38.109020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab485826-6e5e-4f48-ac1f-9033dc9068cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:38.110161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab485826-6e5e-4f48-ac1f-9033dc9068cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:38.111366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab485826-6e5e-4f48-ac1f-9033dc9068cb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:38.123124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1039/2107] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:38.127555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:38.139961 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cdd29-a87f-498a-b0a5-cebae59e6b5f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:38.144836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:38.145527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:38.145806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:38.146078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] PATH_INFO: `/v3/projects/0e7d4da010f04c40a6a4032a761a43e7/users/1dc611cc846b442f81852c7cf5627e5d/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:38.161925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7d4da010f04c40a6a4032a761a43e7, user_id=1dc611cc846b442f81852c7cf5627e5d, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:38.164631 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:38.177828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1069/2108] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:38 2022] PUT /identity/v3/projects/0e7d4da010f04c40a6a4032a761a43e7/users/1dc611cc846b442f81852c7cf5627e5d/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:38.190938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:38.191257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:38.191543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:38.221780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] MFA Rules not processed for user `1dc611cc846b442f81852c7cf5627e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:38.223025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:38.315568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1040/2109] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:38.323595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:38.327529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:38.396727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2278-8eed-40a1-a811-95c2be684200 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:38.400477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c85ff-a119-4d8f-a71f-82aa5f2b2af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:38.401145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c85ff-a119-4d8f-a71f-82aa5f2b2af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:38.401507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c85ff-a119-4d8f-a71f-82aa5f2b2af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:38.401782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c85ff-a119-4d8f-a71f-82aa5f2b2af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:38.411595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c85ff-a119-4d8f-a71f-82aa5f2b2af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:38.413211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c85ff-a119-4d8f-a71f-82aa5f2b2af0 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:38.423793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1070/2110] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:41.691360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:41.692914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:41.788299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f4a85-7798-4c20-bf3b-5f5d6a338fae None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:41.795174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:41.795835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:41.796114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:41.796383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] PATH_INFO: `/v3/users/63256ea7f9a541ff9256a6770b191ec3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:41.797504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63256ea7f9a541ff9256a6770b191ec3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:41.799433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:41.843688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:41.849702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63256ea7f9a541ff9256a6770b191ec3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:41.864371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63256ea7f9a541ff9256a6770b191ec3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:41.872915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63256ea7f9a541ff9256a6770b191ec3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:41.873745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63256ea7f9a541ff9256a6770b191ec3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:41.874439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63256ea7f9a541ff9256a6770b191ec3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:41.889453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1041/2111] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:41 2022] DELETE /identity/v3/users/63256ea7f9a541ff9256a6770b191ec3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:41.894188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:41.894640 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:41.894770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:41.914608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:41.915859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:41.947364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:41.976068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1071/2112] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:41.986065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:41.987514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:42.045088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58fdeb-ca3e-403c-8de8-bee0993b4527 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.048759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7010478-39fd-4035-99f9-657197e743d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.049358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7010478-39fd-4035-99f9-657197e743d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.049631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7010478-39fd-4035-99f9-657197e743d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.049900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7010478-39fd-4035-99f9-657197e743d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.059327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7010478-39fd-4035-99f9-657197e743d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.060713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7010478-39fd-4035-99f9-657197e743d4 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.070501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1042/2113] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:42.347338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:42.348985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:42.363076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23de6-0941-4e66-98f7-b7ef4e0bcfe4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.367850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.368535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.368801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.369070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] PATH_INFO: `/v3/projects/9a43054886c3453582e0e5255d0878b9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.370220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a43054886c3453582e0e5255d0878b9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.373212 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.419380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a43054886c3453582e0e5255d0878b9', 'request_id': 'req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:42.425564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a43054886c3453582e0e5255d0878b9', 'request_id': 'req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:42.431242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a43054886c3453582e0e5255d0878b9', 'request_id': 'req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:42.444579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] The token cache is being invalidate because project 9a43054886c3453582e0e5255d0878b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:42.444865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:42.445477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1990897e-f6c4-4367-8a2d-bfbd0e07a84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:42.447001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1072/2114] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:42 2022] DELETE /identity/v3/projects/9a43054886c3453582e0e5255d0878b9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:42.452012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11cf14-c4c9-4a79-88d5-aba7734e2962 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.452202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11cf14-c4c9-4a79-88d5-aba7734e2962 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.452468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11cf14-c4c9-4a79-88d5-aba7734e2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.472496 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-df11cf14-c4c9-4a79-88d5-aba7734e2962 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:42.473853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-df11cf14-c4c9-4a79-88d5-aba7734e2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:42.535217 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1043/2115] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:42.544709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98cd9a-f169-4834-992e-347d2f8b3bcc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.544988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98cd9a-f169-4834-992e-347d2f8b3bcc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.545258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98cd9a-f169-4834-992e-347d2f8b3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.565855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4a98cd9a-f169-4834-992e-347d2f8b3bcc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:42.567050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4a98cd9a-f169-4834-992e-347d2f8b3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:42.576360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1073/2116] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:42.581310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11cf14-c4c9-4a79-88d5-aba7734e2962 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:42.594853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11cf14-c4c9-4a79-88d5-aba7734e2962 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.600905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.601908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.602473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.603047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.604142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:42.604596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.607317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.620005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1044/2117] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:42.625109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98cd9a-f169-4834-992e-347d2f8b3bcc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:42.634615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98cd9a-f169-4834-992e-347d2f8b3bcc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.640677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.641368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.641745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.642083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.642715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.644747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.673332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1074/2118] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:42 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:42.677477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:42.687838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8f2a4-75f1-4ccf-9adf-4c8bfc951345 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.736378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:42.749400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.750001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.750277 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.750545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.751164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.753201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.774842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1045/2119] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:42 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:42.780544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:42.794688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccffdf-49e9-4de4-8544-0a92413c43b8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.799682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.800343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.800604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.800875 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.801550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.803137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.815456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1075/2120] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:42.818998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:42.830032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d50c2-2c7c-46a9-beb8-a2f77c4b79d6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.834713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f63a3-fd54-4c6e-a0fa-4e55b63a916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.835318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f63a3-fd54-4c6e-a0fa-4e55b63a916e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.835634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f63a3-fd54-4c6e-a0fa-4e55b63a916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.835908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f63a3-fd54-4c6e-a0fa-4e55b63a916e admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.836586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f63a3-fd54-4c6e-a0fa-4e55b63a916e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.838175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f63a3-fd54-4c6e-a0fa-4e55b63a916e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.851578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1046/2121] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:42.860652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:42.870903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6ebec-8d5c-41a4-ad7d-0d4c22945671 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:42.875904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:42.876557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.876833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.877106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] PATH_INFO: `/v3/projects/7fc01c202cdf4e16bac0ec57c0f05f9e/users/ebf415837c7140b49bfddc386f150b6a/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.893775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc01c202cdf4e16bac0ec57c0f05f9e, user_id=ebf415837c7140b49bfddc386f150b6a, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:42.900263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:42.936478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1076/2122] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:42 2022] PUT /identity/v3/projects/7fc01c202cdf4e16bac0ec57c0f05f9e/users/ebf415837c7140b49bfddc386f150b6a/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:42.946938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:42.947279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:42.947678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:42.978651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] MFA Rules not processed for user `ebf415837c7140b49bfddc386f150b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:42.981153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:43.086283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1047/2123] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:43.105000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:43.106731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:43.183267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:43.202251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ea20-841e-45e8-83d1-9acb9d956a9e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:43.208479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef337c2f-d5e6-47fe-9469-11273da55c09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:43.209101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef337c2f-d5e6-47fe-9469-11273da55c09 service glance] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:43.209382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef337c2f-d5e6-47fe-9469-11273da55c09 service glance] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:43.209653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef337c2f-d5e6-47fe-9469-11273da55c09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:43.220669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef337c2f-d5e6-47fe-9469-11273da55c09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:43.222100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef337c2f-d5e6-47fe-9469-11273da55c09 service glance] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:43.231467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1077/2124] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:49.072955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:49.072955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:49.226984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee565f-d5fa-4e33-a894-a9ca18db4cb1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:49.226984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:49.226984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:49.226984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:49.227353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] PATH_INFO: `/v3/users/1dc611cc846b442f81852c7cf5627e5d` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:49.227353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc611cc846b442f81852c7cf5627e5d)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:49.227353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:49.286110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc611cc846b442f81852c7cf5627e5d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:49.310886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:49.317805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc611cc846b442f81852c7cf5627e5d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:49.332424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc611cc846b442f81852c7cf5627e5d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:49.333372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc611cc846b442f81852c7cf5627e5d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:49.334265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc611cc846b442f81852c7cf5627e5d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:49.354129 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1048/2125] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:49 2022] DELETE /identity/v3/users/1dc611cc846b442f81852c7cf5627e5d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:49.358751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724587-6125-4513-a371-ef47e19da01c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:49.359303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724587-6125-4513-a371-ef47e19da01c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:49.359303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724587-6125-4513-a371-ef47e19da01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:49.382915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-14724587-6125-4513-a371-ef47e19da01c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:49.384168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-14724587-6125-4513-a371-ef47e19da01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:49.471115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1078/2126] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:49.483196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:49.486505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:49.559530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4c56-21b2-4ed8-a5a4-2f76982d820d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:49.563936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c4c2c-9445-41fb-baea-90815329dfb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:49.564563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4c2c-9445-41fb-baea-90815329dfb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:49.564911 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4c2c-9445-41fb-baea-90815329dfb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:49.565251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4c2c-9445-41fb-baea-90815329dfb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:49.575581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c4c2c-9445-41fb-baea-90815329dfb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:49.577033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c4c2c-9445-41fb-baea-90815329dfb5 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:49.590460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1049/2127] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:49.801410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e844b-b081-4c73-b62b-f1f50c912ceb None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:49.801795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e844b-b081-4c73-b62b-f1f50c912ceb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:49.802173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e844b-b081-4c73-b62b-f1f50c912ceb None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:49.809451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1079/2128] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:11:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:11:49.829879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:49.830081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:49.830343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:49.865721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:49.867327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:49.926822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e844b-b081-4c73-b62b-f1f50c912ceb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:49.928848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-085e844b-b081-4c73-b62b-f1f50c912ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:49.955793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e844b-b081-4c73-b62b-f1f50c912ceb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:49.960879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:49.961508 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:49.961788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:49.962065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] PATH_INFO: `/v3/users/7e2d039823e64703a62623adb8eb0261` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:49.964034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2d039823e64703a62623adb8eb0261)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:49.967739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.009438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1050/2129] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:11:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:50.010648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.013193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:50.029463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4bdac-3861-4ed8-a0bf-f0fc8fe06b50 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.034922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.035612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.035895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.036170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] PATH_INFO: `/v3/projects/0e7d4da010f04c40a6a4032a761a43e7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.037297 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7d4da010f04c40a6a4032a761a43e7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.039339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.040139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2d039823e64703a62623adb8eb0261'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.040968 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2d039823e64703a62623adb8eb0261'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.057743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2d039823e64703a62623adb8eb0261'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.059194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2d039823e64703a62623adb8eb0261'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.071696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2d039823e64703a62623adb8eb0261'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.088951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1080/2130] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:49 2022] DELETE /identity/v3/users/7e2d039823e64703a62623adb8eb0261 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:11:50.090291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.096450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:50.097279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7d4da010f04c40a6a4032a761a43e7', 'request_id': 'req-3b8db362-b4b2-43d1-98a8-d7e648ac777d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.107351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7d4da010f04c40a6a4032a761a43e7', 'request_id': 'req-3b8db362-b4b2-43d1-98a8-d7e648ac777d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.115153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7d4da010f04c40a6a4032a761a43e7', 'request_id': 'req-3b8db362-b4b2-43d1-98a8-d7e648ac777d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.133110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] The token cache is being invalidate because project 0e7d4da010f04c40a6a4032a761a43e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:50.133407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.134064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.135985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1051/2131] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:50 2022] DELETE /identity/v3/projects/0e7d4da010f04c40a6a4032a761a43e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:50.136121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:50.197428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:50.224271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d29cd-6130-41cf-a67f-f9ad93852b89 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.244231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d694-6c80-4734-b6df-570580a34b85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.246457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d694-6c80-4734-b6df-570580a34b85 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.246808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d694-6c80-4734-b6df-570580a34b85 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.247091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d694-6c80-4734-b6df-570580a34b85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.250049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9b59d694-6c80-4734-b6df-570580a34b85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:50.277549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59d694-6c80-4734-b6df-570580a34b85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.281311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59d694-6c80-4734-b6df-570580a34b85 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.294893 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1081/2132] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:50.352127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.353628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:50.427044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db362-b4b2-43d1-98a8-d7e648ac777d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.493274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.493913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.494408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.494540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] PATH_INFO: `/v3/projects/1a59c78c38a04be7a88b6b2d5fc2508a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.495631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a59c78c38a04be7a88b6b2d5fc2508a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.498274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.552338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a59c78c38a04be7a88b6b2d5fc2508a', 'request_id': 'req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.565433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a59c78c38a04be7a88b6b2d5fc2508a', 'request_id': 'req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.571276 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a59c78c38a04be7a88b6b2d5fc2508a', 'request_id': 'req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.583026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] The token cache is being invalidate because project 1a59c78c38a04be7a88b6b2d5fc2508a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:11:50.583311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.584108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5d68e4dd-8ed2-48a4-9613-a4b6547bcd8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:50.585587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1052/2133] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:11:50 2022] DELETE /identity/v3/projects/1a59c78c38a04be7a88b6b2d5fc2508a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:50.590649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c472f2-27f3-4327-b277-9917e6dd6835 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.591153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c472f2-27f3-4327-b277-9917e6dd6835 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.591438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c472f2-27f3-4327-b277-9917e6dd6835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.614062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b1c472f2-27f3-4327-b277-9917e6dd6835 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:50.615434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b1c472f2-27f3-4327-b277-9917e6dd6835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:50.681543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1082/2134] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:50.691515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7093-8edd-4a17-8870-b1576ec96aa5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.691812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7093-8edd-4a17-8870-b1576ec96aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.692086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7093-8edd-4a17-8870-b1576ec96aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.713675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-557b7093-8edd-4a17-8870-b1576ec96aa5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:50.714938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-557b7093-8edd-4a17-8870-b1576ec96aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:50.723272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1053/2135] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:50.727501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c472f2-27f3-4327-b277-9917e6dd6835 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.738920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c472f2-27f3-4327-b277-9917e6dd6835 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.744165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.744786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.745064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.745334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.746551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:11:50.746854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.748494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.761949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1083/2136] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:11:50.766400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7093-8edd-4a17-8870-b1576ec96aa5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.776983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7093-8edd-4a17-8870-b1576ec96aa5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.781871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.782476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.782900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.783323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.783983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.786350 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.820961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1054/2137] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:11:50 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:11:50.825762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.835740 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496ffb8-1dfb-422a-bdeb-39a1154e5bab admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.896229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.896683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.896962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.897228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.897870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.899792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.925737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1084/2138] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:11:50 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:11:50.927035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.940727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04838077-4e42-4f80-9837-5e497c7fea71 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.945427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.946131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.946457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.946729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.947526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.950099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.951836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:50.961954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1055/2139] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:11:50.966181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:50.976649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea984-9b66-46f8-8dca-d5251ad39726 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:50.981699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ac85-b5f9-44f2-aee0-08e725414171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:50.982292 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ac85-b5f9-44f2-aee0-08e725414171 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:50.982576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ac85-b5f9-44f2-aee0-08e725414171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:50.982848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ac85-b5f9-44f2-aee0-08e725414171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:50.983522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ac85-b5f9-44f2-aee0-08e725414171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:50.985112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ac85-b5f9-44f2-aee0-08e725414171 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:50.996219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1085/2140] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:11:51.000673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:51.010498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d4d1-26a1-4641-8062-59a1808316ca admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:51.016419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:51.017092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:51.017391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:51.017661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] PATH_INFO: `/v3/projects/5cb48d7d19f54f689ea237570118adcf/users/17bcff867a50418fad70762e8981dc74/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:51.033037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb48d7d19f54f689ea237570118adcf, user_id=17bcff867a50418fad70762e8981dc74, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:51.035780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:51.049319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1056/2141] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:11:50 2022] PUT /identity/v3/projects/5cb48d7d19f54f689ea237570118adcf/users/17bcff867a50418fad70762e8981dc74/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:51.060200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425df22c-3296-4a3a-b9ce-1a08af22a4ef None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:51.060486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425df22c-3296-4a3a-b9ce-1a08af22a4ef None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:51.060764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425df22c-3296-4a3a-b9ce-1a08af22a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:51.090657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-425df22c-3296-4a3a-b9ce-1a08af22a4ef None None] MFA Rules not processed for user `17bcff867a50418fad70762e8981dc74`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:51.091930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-425df22c-3296-4a3a-b9ce-1a08af22a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:51.132294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:51.163895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1086/2142] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:51.176173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:51.177998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:51.260254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6cc8a-aa35-4c15-b185-f1cd32f408d6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:51.266534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:51.267172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:51.267477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:51.267834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:51.275891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:51.277974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:51.288478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1057/2143] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:11:58.983331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582bdc-05e2-4583-a7f6-7e8b9c78a7ad None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:58.983843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582bdc-05e2-4583-a7f6-7e8b9c78a7ad None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:58.983942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582bdc-05e2-4583-a7f6-7e8b9c78a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:59.003557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-35582bdc-05e2-4583-a7f6-7e8b9c78a7ad None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:59.004742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-35582bdc-05e2-4583-a7f6-7e8b9c78a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:59.060144 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1087/2144] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:11:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:11:59.100883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:59.102280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:59.171506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1132a-a7a9-4521-bca1-9879742998ac service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:59.176437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826c0a4-f8d3-4e8a-8a64-e803c975981d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:59.177033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826c0a4-f8d3-4e8a-8a64-e803c975981d service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:59.177309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826c0a4-f8d3-4e8a-8a64-e803c975981d service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:59.177577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826c0a4-f8d3-4e8a-8a64-e803c975981d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:59.185526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826c0a4-f8d3-4e8a-8a64-e803c975981d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:59.187153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826c0a4-f8d3-4e8a-8a64-e803c975981d service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:59.195180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1058/2145] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:11:59.681145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582bdc-05e2-4583-a7f6-7e8b9c78a7ad None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:59.751444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582bdc-05e2-4583-a7f6-7e8b9c78a7ad None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:59.755944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:59.756575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:59.756851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:59.757114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] PATH_INFO: `/v3/users/17bcff867a50418fad70762e8981dc74` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:59.758230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bcff867a50418fad70762e8981dc74)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:59.760300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:59.771601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec4139-90ff-4506-b813-15a071fcbdf0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:59.771932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec4139-90ff-4506-b813-15a071fcbdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:59.772201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec4139-90ff-4506-b813-15a071fcbdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:59.797192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8cec4139-90ff-4506-b813-15a071fcbdf0 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:59.798792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8cec4139-90ff-4506-b813-15a071fcbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:59.810528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1059/2146] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 08:11:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:59.819446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bcff867a50418fad70762e8981dc74'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:59.820183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bcff867a50418fad70762e8981dc74'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:59.825543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec4139-90ff-4506-b813-15a071fcbdf0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:59.832561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bcff867a50418fad70762e8981dc74'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:59.833217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bcff867a50418fad70762e8981dc74'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:59.837637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec4139-90ff-4506-b813-15a071fcbdf0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:11:59.840217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-fed12eb0-3c9a-4733-b1f6-2e857d830692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bcff867a50418fad70762e8981dc74'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:11:59.842836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:11:59.843439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:59.843774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:59.844041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:59.845960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:59.853446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1088/2147] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:11:59 2022] DELETE /identity/v3/users/17bcff867a50418fad70762e8981dc74 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:11:59.858780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3764-aa79-441d-a29d-c4103e6ade42 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:11:59.859061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3764-aa79-441d-a29d-c4103e6ade42 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:11:59.859332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3764-aa79-441d-a29d-c4103e6ade42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:11:59.859551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:11:59.861156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:11:59.866394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:11:59.869971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1060/2148] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:11:59.882119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d22a3764-aa79-441d-a29d-c4103e6ade42 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:11:59.883208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d22a3764-aa79-441d-a29d-c4103e6ade42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:59.948566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1089/2149] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:11:59.959134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:11:59.960653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:11:59.992906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:00.026409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69bd73-3586-4e15-82fb-4dfd8778ce6e service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.081392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.082001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.082282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.082556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.093086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.094545 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.105675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1061/2150] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:00.114601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.115045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.115350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.136209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:00.137435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:00.196768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1090/2151] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:12:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:00.209589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.211133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:00.302267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e980c55-daea-48d5-b2c2-9a9b4ae3bc58 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.307778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df225fef-c99e-42db-844c-5f05655e246d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.308712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df225fef-c99e-42db-844c-5f05655e246d service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.309005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df225fef-c99e-42db-844c-5f05655e246d service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.309273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df225fef-c99e-42db-844c-5f05655e246d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.318681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df225fef-c99e-42db-844c-5f05655e246d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.320462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df225fef-c99e-42db-844c-5f05655e246d service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.330031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1062/2152] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:12:00.400809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.403146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:00.421048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bfcb2-3065-45b0-bf29-20ff0e944059 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.435830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.436516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.436784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.437060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] PATH_INFO: `/v3/projects/5cb48d7d19f54f689ea237570118adcf` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.438256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb48d7d19f54f689ea237570118adcf)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.441052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.495189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb48d7d19f54f689ea237570118adcf', 'request_id': 'req-476e55f7-a234-432c-a883-bb71f4ad3637'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:00.502178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb48d7d19f54f689ea237570118adcf', 'request_id': 'req-476e55f7-a234-432c-a883-bb71f4ad3637'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:00.508296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb48d7d19f54f689ea237570118adcf', 'request_id': 'req-476e55f7-a234-432c-a883-bb71f4ad3637'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:00.522008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] The token cache is being invalidate because project 5cb48d7d19f54f689ea237570118adcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:00.522302 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:00.522927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-476e55f7-a234-432c-a883-bb71f4ad3637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:00.524442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1091/2153] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:00 2022] DELETE /identity/v3/projects/5cb48d7d19f54f689ea237570118adcf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:00.530148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ae3d-974d-4c92-baee-e677a7134902 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.530450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ae3d-974d-4c92-baee-e677a7134902 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.530754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ae3d-974d-4c92-baee-e677a7134902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.551822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e092ae3d-974d-4c92-baee-e677a7134902 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:00.553619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e092ae3d-974d-4c92-baee-e677a7134902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:00.624058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1063/2154] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:00.633695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b953-7531-4dd5-9702-6ee369ce6f1a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.633974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b953-7531-4dd5-9702-6ee369ce6f1a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.634246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b953-7531-4dd5-9702-6ee369ce6f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.657077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3945b953-7531-4dd5-9702-6ee369ce6f1a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:00.658713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3945b953-7531-4dd5-9702-6ee369ce6f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:00.667101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1092/2155] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:00.671670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ae3d-974d-4c92-baee-e677a7134902 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.681286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ae3d-974d-4c92-baee-e677a7134902 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.687248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.687908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.688125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.688649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.689302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:00.689602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.691530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.693107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.693220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.693461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.707688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1064/2156] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:12:00.708573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.712878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:00.713750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:00.714083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:00.721064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787847d-dd76-406c-a7d9-3eabb0286b03 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.727976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.728588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.728866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.729146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.731809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.734133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.736384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:00.770899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1065/2157] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:00 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:00.775338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.784125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1093/2158] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 08:12:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:00.795880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.797468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:00.867887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc7a8-279f-4bec-a9b0-ab518b9888ae admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.876921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.877779 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.878054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.878322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.878952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.881056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.884364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e70fb-281a-4ddd-93a9-8e520274ba51 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.907137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1066/2159] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:00 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:00.911441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.925109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844d720-adfa-45cc-bccc-831c2c1f6d4b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.931343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.931993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.932269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.932540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.933886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.935799 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.950560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1067/2160] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:00.952612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:00.954880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6892d-9a78-46e1-af92-7e4b40806a27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.955606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6892d-9a78-46e1-af92-7e4b40806a27 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.955879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6892d-9a78-46e1-af92-7e4b40806a27 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.956061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6892d-9a78-46e1-af92-7e4b40806a27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.962950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc2041-6903-4b7e-993c-b42fccdd60e7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:00.967849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:00.968459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:00.968741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:00.969016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:00.969660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:00.971302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:00.983495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1068/2161] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:00.987715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.000296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dac1c7-bb67-4881-9ef9-2829c24abeee admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.005336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.005986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.006266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.006537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] PATH_INFO: `/v3/projects/8ae784dc3fa440c8b3ffbf8989d5c3fc/users/cc2d77452e13450f803358794ace4a6c/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.022961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae784dc3fa440c8b3ffbf8989d5c3fc, user_id=cc2d77452e13450f803358794ace4a6c, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.023564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6892d-9a78-46e1-af92-7e4b40806a27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.025736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.025850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6892d-9a78-46e1-af92-7e4b40806a27 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.034449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1094/2162] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 08:12:01.041198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1069/2163] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:00 2022] PUT /identity/v3/projects/8ae784dc3fa440c8b3ffbf8989d5c3fc/users/cc2d77452e13450f803358794ace4a6c/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:01.053958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12697dd-f987-4fb5-90b1-38767f0db310 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.053958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12697dd-f987-4fb5-90b1-38767f0db310 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.054214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12697dd-f987-4fb5-90b1-38767f0db310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.081741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:01.084984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c12697dd-f987-4fb5-90b1-38767f0db310 None None] MFA Rules not processed for user `cc2d77452e13450f803358794ace4a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:01.086914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c12697dd-f987-4fb5-90b1-38767f0db310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:01.162985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1095/2164] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:01 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:01.168010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.242458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d071a-bea5-4d5f-8f9f-512c4a596a6a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.248838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.249457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.250017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.250299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.250937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.253054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.288087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1070/2165] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:01 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:01.292827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12697dd-f987-4fb5-90b1-38767f0db310 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.319911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12697dd-f987-4fb5-90b1-38767f0db310 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.409672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.410366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.410723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.411063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.411794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.413831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.445324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1096/2166] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:01 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:01.449288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.460158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e425-954c-44d1-a4eb-45e38a3c4574 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.465328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.465926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.466207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.466505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.467270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.468908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.471111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:01.481723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1071/2167] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:01.486073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.496289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87b908-a5ca-4244-9fc0-375ddd92de82 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.501390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.502040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.502320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.502594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] PATH_INFO: `/v3/projects/25ef5c6b00044611bc09642d70735a23/users/2f3fd6ea6397403c819bb0ccea00afce/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.518417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ef5c6b00044611bc09642d70735a23, user_id=2f3fd6ea6397403c819bb0ccea00afce, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.521145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.534962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1097/2168] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:01 2022] PUT /identity/v3/projects/25ef5c6b00044611bc09642d70735a23/users/2f3fd6ea6397403c819bb0ccea00afce/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:01.538863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.550025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf69330-6878-4d78-a7a2-cb2d10e0e81b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.610602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56138b70-fc0a-4479-9f35-51a32d2566df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.611218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138b70-fc0a-4479-9f35-51a32d2566df admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.611652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138b70-fc0a-4479-9f35-51a32d2566df admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.611928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138b70-fc0a-4479-9f35-51a32d2566df admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.612574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56138b70-fc0a-4479-9f35-51a32d2566df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.614158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56138b70-fc0a-4479-9f35-51a32d2566df admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.624543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1072/2169] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:01.628923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.639293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2bf3a-629d-434c-be36-a3bf4393f1b5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.643969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.644623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.644902 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.645177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] PATH_INFO: `/v3/projects/25ef5c6b00044611bc09642d70735a23/users/2f3fd6ea6397403c819bb0ccea00afce/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.647079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ef5c6b00044611bc09642d70735a23, user_id=2f3fd6ea6397403c819bb0ccea00afce, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.652411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.662411 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1098/2170] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:01 2022] PUT /identity/v3/projects/25ef5c6b00044611bc09642d70735a23/users/2f3fd6ea6397403c819bb0ccea00afce/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:01.673834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd21-9b9c-4b80-8802-bd380db65954 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.674120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd21-9b9c-4b80-8802-bd380db65954 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.674399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd21-9b9c-4b80-8802-bd380db65954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.705014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6842bd21-9b9c-4b80-8802-bd380db65954 None None] MFA Rules not processed for user `2f3fd6ea6397403c819bb0ccea00afce`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:01.706229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6842bd21-9b9c-4b80-8802-bd380db65954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:01.784713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1073/2171] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:01.798157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:01.799962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:01.864668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e64df7-5f7e-4a6b-8b4c-8005669becff admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:01.868493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3c721-8e75-4aa3-ac65-453dbfd90715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:01.869158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c721-8e75-4aa3-ac65-453dbfd90715 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:01.869437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c721-8e75-4aa3-ac65-453dbfd90715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:01.869707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c721-8e75-4aa3-ac65-453dbfd90715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:01.882910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3c721-8e75-4aa3-ac65-453dbfd90715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:01.884372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3c721-8e75-4aa3-ac65-453dbfd90715 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:01.889327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:01.899691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1099/2172] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:01 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:02.137292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842bd21-9b9c-4b80-8802-bd380db65954 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:02.206654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842bd21-9b9c-4b80-8802-bd380db65954 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:02.211565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:02.212189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:02.212466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:02.212735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] PATH_INFO: `/v3/users/cc2d77452e13450f803358794ace4a6c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:02.213850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2d77452e13450f803358794ace4a6c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:02.215830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:02.240715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:02.269915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2d77452e13450f803358794ace4a6c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.281672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2d77452e13450f803358794ace4a6c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.288441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2d77452e13450f803358794ace4a6c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.289107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2d77452e13450f803358794ace4a6c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.289716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2d77452e13450f803358794ace4a6c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.305958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1074/2173] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:02 2022] DELETE /identity/v3/users/cc2d77452e13450f803358794ace4a6c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:02.310951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:02.311437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:02.311532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:02.331619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:02.332862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:02.391267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1100/2174] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:02.404426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:02.405867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:02.471112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85738b57-6316-4f4d-be78-95f869b30cfe admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:02.475325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:02.475964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:02.476244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:02.476515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:02.486218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:02.488006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:02.498465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1075/2175] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:02.880859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:02.882453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:02.899996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d70e8-38b0-4c9c-b5e6-ac30a5f28391 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:02.905836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:02.906741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:02.907264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:02.907579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] PATH_INFO: `/v3/projects/8ae784dc3fa440c8b3ffbf8989d5c3fc` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:02.908827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae784dc3fa440c8b3ffbf8989d5c3fc)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:02.910763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:02.961182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae784dc3fa440c8b3ffbf8989d5c3fc', 'request_id': 'req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.967695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae784dc3fa440c8b3ffbf8989d5c3fc', 'request_id': 'req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.974877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae784dc3fa440c8b3ffbf8989d5c3fc', 'request_id': 'req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.989583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] The token cache is being invalidate because project 8ae784dc3fa440c8b3ffbf8989d5c3fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:02.989871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.990518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:02.992404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1101/2176] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:02 2022] DELETE /identity/v3/projects/8ae784dc3fa440c8b3ffbf8989d5c3fc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:02.996851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.011934 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1a08-fc4e-48cc-ae33-0d5675f94fba service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:03.079896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:03.080524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.080921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.081221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] PATH_INFO: `/v3/users/2f3fd6ea6397403c819bb0ccea00afce` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.082333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3fd6ea6397403c819bb0ccea00afce)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:03.084322 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:03.141255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:03.154336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3fd6ea6397403c819bb0ccea00afce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.170368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3fd6ea6397403c819bb0ccea00afce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.178137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3fd6ea6397403c819bb0ccea00afce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.179077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3fd6ea6397403c819bb0ccea00afce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.179801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b200443c-368b-4963-86cf-dcd3e9ddbeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3fd6ea6397403c819bb0ccea00afce'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.196259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1076/2177] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:02 2022] DELETE /identity/v3/users/2f3fd6ea6397403c819bb0ccea00afce => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:03.291507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.291507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:03.305297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f054-c1ec-4123-b3ea-1bd53b01fbf9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:03.365114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:03.365793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.366073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.366343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] PATH_INFO: `/v3/users/52d24256e4534136bd80ad6f969d44a2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.367510 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d24256e4534136bd80ad6f969d44a2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:03.369569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:03.393710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:03.420335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d24256e4534136bd80ad6f969d44a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.420991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d24256e4534136bd80ad6f969d44a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.434074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d24256e4534136bd80ad6f969d44a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.434857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d24256e4534136bd80ad6f969d44a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.441784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d24256e4534136bd80ad6f969d44a2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.456823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1102/2178] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:03 2022] DELETE /identity/v3/users/52d24256e4534136bd80ad6f969d44a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:03.461097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fb042-04c7-464c-815a-350eae54dead None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.461568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fb042-04c7-464c-815a-350eae54dead None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.461673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fb042-04c7-464c-815a-350eae54dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.481782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f02fb042-04c7-464c-815a-350eae54dead None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:03.483013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f02fb042-04c7-464c-815a-350eae54dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:03.495269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.496954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:03.551510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1077/2179] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:03.562775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fb042-04c7-464c-815a-350eae54dead None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.564585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f02fb042-04c7-464c-815a-350eae54dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:03.569701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c602-889c-41a5-b39f-c3d92258bf67 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:03.575632 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:03.576300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.576576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.576849 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] PATH_INFO: `/v3/projects/25ef5c6b00044611bc09642d70735a23` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.577969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ef5c6b00044611bc09642d70735a23)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:03.579925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:03.624115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fb042-04c7-464c-815a-350eae54dead None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:03.627272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ef5c6b00044611bc09642d70735a23', 'request_id': 'req-82557a3d-5038-45b7-b8e9-a32ad3d48e85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.633474 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ef5c6b00044611bc09642d70735a23', 'request_id': 'req-82557a3d-5038-45b7-b8e9-a32ad3d48e85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.639923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ef5c6b00044611bc09642d70735a23', 'request_id': 'req-82557a3d-5038-45b7-b8e9-a32ad3d48e85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.654257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] The token cache is being invalidate because project 25ef5c6b00044611bc09642d70735a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:03.654462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.655107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-82557a3d-5038-45b7-b8e9-a32ad3d48e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:03.656622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1103/2180] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:03 2022] DELETE /identity/v3/projects/25ef5c6b00044611bc09642d70735a23 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:03.661568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8f3e-99e9-4f34-a84a-297e0ec4391a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.661849 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8f3e-99e9-4f34-a84a-297e0ec4391a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.662121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8f3e-99e9-4f34-a84a-297e0ec4391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.681190 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-328a8f3e-99e9-4f34-a84a-297e0ec4391a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:03.682053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:03.682391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-328a8f3e-99e9-4f34-a84a-297e0ec4391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:03.682648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.683676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.684002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.685884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:03.709191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:03.717458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:03.745747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1104/2181] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:03.753798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:03.754364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447f6c-8993-423a-8b58-c771005c49f1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.754646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447f6c-8993-423a-8b58-c771005c49f1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.754913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447f6c-8993-423a-8b58-c771005c49f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.755253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:03.765460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1078/2182] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:03.774801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-34447f6c-8993-423a-8b58-c771005c49f1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:03.776142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-34447f6c-8993-423a-8b58-c771005c49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:03.784669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1105/2183] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:03.788825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.799104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce150-eef3-433d-ae90-37ea49f2e6dc service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:03.803644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:03.804243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.804516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.804782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.805419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:03.805716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:03.807315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:03.826220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1079/2184] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:12:03.830437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447f6c-8993-423a-8b58-c771005c49f1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.840332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447f6c-8993-423a-8b58-c771005c49f1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:03.845114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:03.845782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.846064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.846331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.846963 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:03.849034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:03.877002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1106/2185] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:03 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:03.880987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.891759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf9620-8020-4f0a-b0f0-1c954eab0b10 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:03.950985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:03.951633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:03.951915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:03.952189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:03.953109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:03.955229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:03.980509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1080/2186] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:03 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:03.984167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:03.995324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacb2c2-3ceb-46a7-af15-5e626e0e7fcf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.001786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.002602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.002979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.003299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.004012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.005635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.018552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1107/2187] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:04.024232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.040925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.043225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.061253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413adacb-4e7d-4efe-89d4-e48452d12dc8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.066117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58ae8-a9c5-471c-8103-2836ebdcdd4c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.067339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.067956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.068242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.068494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] PATH_INFO: `/v3/projects/f4b13c8e17aa4627b5f2d76e7388865a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.069616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b13c8e17aa4627b5f2d76e7388865a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.071525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.072676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.073286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.074516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.074808 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.075481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.077077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.090657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1081/2188] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:04.094793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.106240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734a2c-297c-4b7d-84e1-0969c39241c7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.110958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1ee09-065d-4002-bd0d-1b01839ff46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.111639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ee09-065d-4002-bd0d-1b01839ff46f admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.111920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ee09-065d-4002-bd0d-1b01839ff46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.112192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ee09-065d-4002-bd0d-1b01839ff46f admin admin] PATH_INFO: `/v3/projects/5eabb647608b42aebed57c0bb74a5cde/users/f7666e1a393440e5966ebfecc45d25e7/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.120431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b13c8e17aa4627b5f2d76e7388865a', 'request_id': 'req-2c0a3852-df52-488f-bc57-3f764eca7ea6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:04.126768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b13c8e17aa4627b5f2d76e7388865a', 'request_id': 'req-2c0a3852-df52-488f-bc57-3f764eca7ea6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:04.127650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1ee09-065d-4002-bd0d-1b01839ff46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eabb647608b42aebed57c0bb74a5cde, user_id=f7666e1a393440e5966ebfecc45d25e7, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.130442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1ee09-065d-4002-bd0d-1b01839ff46f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.132542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b13c8e17aa4627b5f2d76e7388865a', 'request_id': 'req-2c0a3852-df52-488f-bc57-3f764eca7ea6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:04.146237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1082/2189] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:04 2022] PUT /identity/v3/projects/5eabb647608b42aebed57c0bb74a5cde/users/f7666e1a393440e5966ebfecc45d25e7/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:04.148230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] The token cache is being invalidate because project f4b13c8e17aa4627b5f2d76e7388865a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:04.148521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:04.149162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c0a3852-df52-488f-bc57-3f764eca7ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:04.150678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1108/2190] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:04 2022] DELETE /identity/v3/projects/f4b13c8e17aa4627b5f2d76e7388865a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:04.156302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ec235-c3b0-4db3-8626-8787c87f9218 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.156588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ec235-c3b0-4db3-8626-8787c87f9218 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.156847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.156962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ec235-c3b0-4db3-8626-8787c87f9218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.157128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.157401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.177956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-294ec235-c3b0-4db3-8626-8787c87f9218 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:04.179160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-294ec235-c3b0-4db3-8626-8787c87f9218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.186356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] MFA Rules not processed for user `f7666e1a393440e5966ebfecc45d25e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:04.187529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.244021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1083/2191] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:04.253531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5ff2b-3e4c-41da-92c6-c2a63cda63cc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.253818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5ff2b-3e4c-41da-92c6-c2a63cda63cc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.254368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5ff2b-3e4c-41da-92c6-c2a63cda63cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.256719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1109/2192] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:04.261616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.263000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.272050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:04.277844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2073-9622-4aa6-8bec-a3c8886106a9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.278554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-42e5ff2b-3e4c-41da-92c6-c2a63cda63cc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:04.280409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-42e5ff2b-3e4c-41da-92c6-c2a63cda63cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.284382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.285008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.285328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.285627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.286509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.288791 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.297517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1084/2193] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:04.301773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5ff2b-3e4c-41da-92c6-c2a63cda63cc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.306351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:04.312773 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5ff2b-3e4c-41da-92c6-c2a63cda63cc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.319739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.320447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.320821 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.321190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.322006 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:04.322402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.323350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1110/2194] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:04.327683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.327815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.340425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1085/2195] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:12:04.345425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.361390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d996ae-5e13-43df-891b-fbd81ac5351b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.404744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6dcfa-d8e1-4edb-b8a1-9460c19781a2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.411187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.411944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.412592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.412964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.413687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.416513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.419882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.420606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.420882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.421140 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.421758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.423664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.443294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1111/2196] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:04.447713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.453553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1086/2197] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:04.458320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.461036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862ae6-f194-4252-80c7-7634baa34372 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.528510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a16254-acf0-4b97-844e-98b83ebe803d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.533486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.533660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.534116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.534254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.534391 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.534525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.534691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.534797 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.535493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.535784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.537525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.537715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.550248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1112/2198] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:04.554644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.560785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1087/2199] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:04.564740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.567399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9912575-830e-4649-b991-7f9aeb2eca47 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.576101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.576912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.577070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff2700-a2f6-4f08-8958-fc84c72d78c3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.577322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.577801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] PATH_INFO: `/v3/projects/41ea6d47f0fd4d97a6c00145d6b51ec2/users/eede4f8f84994806a6dec21c810ed0db/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.582164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.582946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.583403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.583886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.585240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.587029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.600104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ea6d47f0fd4d97a6c00145d6b51ec2, user_id=eede4f8f84994806a6dec21c810ed0db, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.600744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1088/2200] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:04.603072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.604582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.616570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f7a8a-256c-4d83-bc73-263d42fccf14 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.625059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1113/2201] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:04 2022] PUT /identity/v3/projects/41ea6d47f0fd4d97a6c00145d6b51ec2/users/eede4f8f84994806a6dec21c810ed0db/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:04.626260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.678841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:04.679368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:04.694499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.695166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.695477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.695748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.696624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.698354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.700029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a862fda-e1cf-42eb-915a-c9485478033b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.706367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.706982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.707257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.707649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.708346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.710086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.714841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1089/2202] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:04.716166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.721196 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1114/2203] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:04.725424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.729521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f36d6-0c53-4b0a-ab80-b60e3cc172fe admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.734957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503d7c3-a752-48bf-bf32-7ce90d15d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.735595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c4f07-befd-4539-92f2-588f65553f7e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.735736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503d7c3-a752-48bf-bf32-7ce90d15d248 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.735930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503d7c3-a752-48bf-bf32-7ce90d15d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.736201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503d7c3-a752-48bf-bf32-7ce90d15d248 admin admin] PATH_INFO: `/v3/projects/4c0b8cce674f4a7581301575ea567b80/users/b83b1a254074456897dcb9430e29d4b7/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.741415 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6728177-5289-4ebf-8b89-7960688d5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.742113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6728177-5289-4ebf-8b89-7960688d5709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.742389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6728177-5289-4ebf-8b89-7960688d5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.742658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6728177-5289-4ebf-8b89-7960688d5709 admin admin] PATH_INFO: `/v3/projects/41ea6d47f0fd4d97a6c00145d6b51ec2/users/eede4f8f84994806a6dec21c810ed0db/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.744582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6728177-5289-4ebf-8b89-7960688d5709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ea6d47f0fd4d97a6c00145d6b51ec2, user_id=eede4f8f84994806a6dec21c810ed0db, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.749787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6728177-5289-4ebf-8b89-7960688d5709 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.752659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503d7c3-a752-48bf-bf32-7ce90d15d248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0b8cce674f4a7581301575ea567b80, user_id=b83b1a254074456897dcb9430e29d4b7, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.755325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503d7c3-a752-48bf-bf32-7ce90d15d248 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.760565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1115/2204] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:04 2022] PUT /identity/v3/projects/41ea6d47f0fd4d97a6c00145d6b51ec2/users/eede4f8f84994806a6dec21c810ed0db/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:04.770203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1090/2205] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:04 2022] PUT /identity/v3/projects/4c0b8cce674f4a7581301575ea567b80/users/b83b1a254074456897dcb9430e29d4b7/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:04.772211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.772530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.772768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.774852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.775228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.775535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.795062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:04.796388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.804824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] MFA Rules not processed for user `eede4f8f84994806a6dec21c810ed0db`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:04.806045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.857614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1091/2206] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:04.867092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.868490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.874868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1116/2207] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:04.886954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:04.888380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:04.925052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136288b2-2524-4693-82c2-41a42fe53fe5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.928801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.929406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.929713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.929985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.940486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.942119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.949613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65298-c6e3-4673-a173-b926de51245a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:04.952348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1092/2208] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:12:04.953502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c720fd-9568-44ef-8773-e9e43550acf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:04.954107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c720fd-9568-44ef-8773-e9e43550acf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:04.954382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c720fd-9568-44ef-8773-e9e43550acf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:04.954646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c720fd-9568-44ef-8773-e9e43550acf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:04.964442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c720fd-9568-44ef-8773-e9e43550acf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:04.966001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c720fd-9568-44ef-8773-e9e43550acf5 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:04.975998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1117/2209] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:12:05.071268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:05.083134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38ec54-8e65-40f6-a93b-17331db72855 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:05.090045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:05.090778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:05.091725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:05.091725 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:05.189128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:05.190843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:05.200806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1093/2210] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:12:09.051789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca79bd-8ffa-4b67-902d-e749e7f2a8e2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:09.052975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca79bd-8ffa-4b67-902d-e749e7f2a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:09.053402 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca79bd-8ffa-4b67-902d-e749e7f2a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:09.094259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ddca79bd-8ffa-4b67-902d-e749e7f2a8e2 None None] MFA Rules not processed for user `b83b1a254074456897dcb9430e29d4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:09.095582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ddca79bd-8ffa-4b67-902d-e749e7f2a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:09.155081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:09.179203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1118/2211] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:09.184577 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:09.195795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b028-069d-46c1-beb0-6f402432054d service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:09.201341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:09.201838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:09.202117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:09.202388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:09.203019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:09.205172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:09.209970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:09.252778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1094/2212] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:09 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:09.256807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca79bd-8ffa-4b67-902d-e749e7f2a8e2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:09.269986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca79bd-8ffa-4b67-902d-e749e7f2a8e2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:09.339388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:09.340120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:09.340400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:09.340669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:09.341300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:09.343219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:09.367254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1119/2213] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:09 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:09.371857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:09.382622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397eb84-58c9-4233-b952-c75bbd07333a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:09.389271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:09.389893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:09.390167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:09.390432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:09.391138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:09.392846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:09.404471 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1095/2214] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:09.408613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:09.419626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d1190-9a8e-4273-98c9-2e0717762bc7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:09.424403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:09.425078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:09.425356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:09.425629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] PATH_INFO: `/v3/projects/78056d4a94c64f9593f1e0124474d5c6/users/a54eb7c86a9e4fc88a5bca787fa92b4c/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:09.442504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78056d4a94c64f9593f1e0124474d5c6, user_id=a54eb7c86a9e4fc88a5bca787fa92b4c, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:09.445281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:09.459472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1120/2215] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:09 2022] PUT /identity/v3/projects/78056d4a94c64f9593f1e0124474d5c6/users/a54eb7c86a9e4fc88a5bca787fa92b4c/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:09.463474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:09.474637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57750d32-d6c0-4079-8b04-2e44bac005db admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:09.533249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae039-050d-4774-89b5-433d86212bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:09.533863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae039-050d-4774-89b5-433d86212bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:09.534142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae039-050d-4774-89b5-433d86212bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:09.534426 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae039-050d-4774-89b5-433d86212bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:09.535057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cae039-050d-4774-89b5-433d86212bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:09.536722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cae039-050d-4774-89b5-433d86212bb8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:09.547815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1096/2216] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:09.551947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:09.563139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2150b-8a3c-4a4b-ba3c-8b1316892d47 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:09.568837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:09.569782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:09.570153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:09.570523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] PATH_INFO: `/v3/projects/78056d4a94c64f9593f1e0124474d5c6/users/a54eb7c86a9e4fc88a5bca787fa92b4c/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:09.573579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78056d4a94c64f9593f1e0124474d5c6, user_id=a54eb7c86a9e4fc88a5bca787fa92b4c, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:09.577064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:09.589085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1121/2217] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:09 2022] PUT /identity/v3/projects/78056d4a94c64f9593f1e0124474d5c6/users/a54eb7c86a9e4fc88a5bca787fa92b4c/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:14.500089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:14.500576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:14.500754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:14.532218 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] MFA Rules not processed for user `a54eb7c86a9e4fc88a5bca787fa92b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:14.533646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:14.606989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1097/2218] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:14.621735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:14.623747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:14.732630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa1de-405e-424e-a479-9f46c0e362b3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:14.738598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15359a6-0e88-49d4-8e4e-1811d1449d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:14.739223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15359a6-0e88-49d4-8e4e-1811d1449d42 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:14.739929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15359a6-0e88-49d4-8e4e-1811d1449d42 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:14.740205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15359a6-0e88-49d4-8e4e-1811d1449d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:14.783290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:14.865794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15359a6-0e88-49d4-8e4e-1811d1449d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:14.875502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15359a6-0e88-49d4-8e4e-1811d1449d42 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:14.909863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1122/2219] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:17.153410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:17.154907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:17.242408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:17.255249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765b77-c371-455b-b15f-127cc8fa4415 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:17.260430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:17.261660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:17.261936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:17.262209 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] PATH_INFO: `/v3/users/ebf415837c7140b49bfddc386f150b6a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:17.263375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf415837c7140b49bfddc386f150b6a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:17.265340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:17.316516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf415837c7140b49bfddc386f150b6a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:17.330379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf415837c7140b49bfddc386f150b6a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:17.337714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf415837c7140b49bfddc386f150b6a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:17.338711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf415837c7140b49bfddc386f150b6a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:17.339073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf415837c7140b49bfddc386f150b6a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:17.353735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1098/2220] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:17 2022] DELETE /identity/v3/users/ebf415837c7140b49bfddc386f150b6a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:17.358407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:17.358845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:17.358938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:17.378373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:17.379597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:17.445030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1123/2221] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:17.456192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:17.457787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:17.532225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e696c-4f2b-4965-b073-5df42432f0c0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:17.535870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:17.536506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:17.536786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:17.537056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:17.547382 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:17.548863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:17.567731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1099/2222] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:17.939772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:17.941340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:17.968381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ede22-03e1-45f3-bfc5-a710a7f3185d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:17.975889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:17.977431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:17.977882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:17.978299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] PATH_INFO: `/v3/projects/7fc01c202cdf4e16bac0ec57c0f05f9e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:17.981123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc01c202cdf4e16bac0ec57c0f05f9e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:17.983523 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.110983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc01c202cdf4e16bac0ec57c0f05f9e', 'request_id': 'req-2cf938f7-9d1c-4103-9cee-6d5d8e712211'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.120628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc01c202cdf4e16bac0ec57c0f05f9e', 'request_id': 'req-2cf938f7-9d1c-4103-9cee-6d5d8e712211'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.127783 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc01c202cdf4e16bac0ec57c0f05f9e', 'request_id': 'req-2cf938f7-9d1c-4103-9cee-6d5d8e712211'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.145379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] The token cache is being invalidate because project 7fc01c202cdf4e16bac0ec57c0f05f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:18.145839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.147272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2cf938f7-9d1c-4103-9cee-6d5d8e712211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.151934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1124/2223] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:17 2022] DELETE /identity/v3/projects/7fc01c202cdf4e16bac0ec57c0f05f9e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:18.152125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.154377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:18.156933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871236-bca2-4f4d-8ccf-0e273d49e591 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.157546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871236-bca2-4f4d-8ccf-0e273d49e591 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.157887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871236-bca2-4f4d-8ccf-0e273d49e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.169244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c575d4-c8b1-47bd-8d0e-3b02bf214a30 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.183727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e3871236-bca2-4f4d-8ccf-0e273d49e591 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:18.184941 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e3871236-bca2-4f4d-8ccf-0e273d49e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:18.247574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.248194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.248526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.249154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] PATH_INFO: `/v3/users/f7666e1a393440e5966ebfecc45d25e7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.250036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:18.250643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7666e1a393440e5966ebfecc45d25e7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.252930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.268404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1125/2224] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:18.277175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177fc1-bc73-4f94-866c-af2300d865c9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.277782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177fc1-bc73-4f94-866c-af2300d865c9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.278275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177fc1-bc73-4f94-866c-af2300d865c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.282485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:18.315138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a3177fc1-bc73-4f94-866c-af2300d865c9 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:18.317949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a3177fc1-bc73-4f94-866c-af2300d865c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:18.340593 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7666e1a393440e5966ebfecc45d25e7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.344864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1126/2225] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:18.350694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3177fc1-bc73-4f94-866c-af2300d865c9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.372115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3177fc1-bc73-4f94-866c-af2300d865c9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.374942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7666e1a393440e5966ebfecc45d25e7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.379773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.380396 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.380675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.381248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.381914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:18.382242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.385324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.393346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7666e1a393440e5966ebfecc45d25e7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.394104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7666e1a393440e5966ebfecc45d25e7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.394763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-314d7978-1681-4142-8498-b8076be645cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7666e1a393440e5966ebfecc45d25e7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:18.405004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1127/2226] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:12:18.411256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.413845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:18.415352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1100/2227] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:18 2022] DELETE /identity/v3/users/f7666e1a393440e5966ebfecc45d25e7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:18.420001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.420850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.420850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.435452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4c31f-096c-4c83-b1b5-649d361aa26f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.449730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:18.451015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:18.513024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.514249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.514644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.514985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.515659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.517544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.521982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1101/2228] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:18.535814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.538149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:18.554693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1128/2229] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:18 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:18.559848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.606115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801558f4-08b1-45ff-89de-67a0fcbd29f1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.639157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375f200-e222-4efa-91cb-68217288c21a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.644288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.644882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.645244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.645582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.646324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.648353 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.681407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1129/2230] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:18 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:18.684469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.685189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.685474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.685766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.686028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.697612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fb710-1e09-43eb-899b-02e2f8d240bb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.701461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.704852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.705642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.705915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.706197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.707161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.709003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.709443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.714839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:18.734864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1102/2231] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:18.742820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1130/2232] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:18.748177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.762714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f85a-b721-419b-af65-4a1c1e5c7cc8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.768244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cad5db-8f5d-42e4-994f-060b99fe1844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.768771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cad5db-8f5d-42e4-994f-060b99fe1844 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.769053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cad5db-8f5d-42e4-994f-060b99fe1844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.769323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cad5db-8f5d-42e4-994f-060b99fe1844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.769966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cad5db-8f5d-42e4-994f-060b99fe1844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.771642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cad5db-8f5d-42e4-994f-060b99fe1844 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.785714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1131/2233] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:18.789849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:18.802782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f89e-5234-49fb-8fde-6aa0068edec9 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:18.808678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:18.809802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.810334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.810735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] PATH_INFO: `/v3/projects/37ef1826633a4dafb2ed1c9669ada260/users/33c019a245de4785970c1c06a7ead411/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.831957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ef1826633a4dafb2ed1c9669ada260, user_id=33c019a245de4785970c1c06a7ead411, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:18.835366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:18.862393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1103/2234] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:18 2022] PUT /identity/v3/projects/37ef1826633a4dafb2ed1c9669ada260/users/33c019a245de4785970c1c06a7ead411/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:18.874257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a786-557c-4c72-a943-27392d68747d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:18.874528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a786-557c-4c72-a943-27392d68747d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:18.874958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a786-557c-4c72-a943-27392d68747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:18.918162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a092a786-557c-4c72-a943-27392d68747d None None] MFA Rules not processed for user `33c019a245de4785970c1c06a7ead411`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:18.919723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a092a786-557c-4c72-a943-27392d68747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:18.954009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:19.068039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1132/2235] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:19.072043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:19.073973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:19.160345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecc675-336d-4737-b81b-0e1ea88c3f09 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:19.173358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:19.173992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:19.174271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:19.174546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:19.182487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a786-557c-4c72-a943-27392d68747d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:19.195439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a092a786-557c-4c72-a943-27392d68747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:19.209371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:19.210191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:19.240428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1104/2236] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:19.261806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:19.347896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a786-557c-4c72-a943-27392d68747d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:19.372110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:19.372817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:19.373026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:19.373294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] PATH_INFO: `/v3/projects/5eabb647608b42aebed57c0bb74a5cde` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:19.374442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eabb647608b42aebed57c0bb74a5cde)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:19.376384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:19.419875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a27d51-e5df-476f-8e3b-09bc0929b6ad service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:19.427190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:19.428126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:19.428315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:19.428564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] PATH_INFO: `/v3/users/33c019a245de4785970c1c06a7ead411` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:19.430254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c019a245de4785970c1c06a7ead411)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:19.431824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:19.447514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eabb647608b42aebed57c0bb74a5cde', 'request_id': 'req-f3d798d7-d555-45b3-b256-f0173a3053e2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.457786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eabb647608b42aebed57c0bb74a5cde', 'request_id': 'req-f3d798d7-d555-45b3-b256-f0173a3053e2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.465714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eabb647608b42aebed57c0bb74a5cde', 'request_id': 'req-f3d798d7-d555-45b3-b256-f0173a3053e2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.480554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] The token cache is being invalidate because project 5eabb647608b42aebed57c0bb74a5cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:19.481824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.482658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.487005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1133/2237] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:19 2022] DELETE /identity/v3/projects/5eabb647608b42aebed57c0bb74a5cde => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:19.490903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:19.492681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:19.517449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c019a245de4785970c1c06a7ead411'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.539980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c019a245de4785970c1c06a7ead411'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.555848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c019a245de4785970c1c06a7ead411'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.556612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c019a245de4785970c1c06a7ead411'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.557283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-db4fbcf8-cbf8-42ea-9105-91c798e2fef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c019a245de4785970c1c06a7ead411'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.560607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:19.562234 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:19.577517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1105/2238] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:19 2022] DELETE /identity/v3/users/33c019a245de4785970c1c06a7ead411 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:19.581040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d798d7-d555-45b3-b256-f0173a3053e2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:19.581703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:19.582004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:19.582287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:19.603450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:19.605517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:19.672551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:19.673488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:19.673821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:19.674095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] PATH_INFO: `/v3/users/eede4f8f84994806a6dec21c810ed0db` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:19.676030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eede4f8f84994806a6dec21c810ed0db)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:19.678134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:19.694440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1106/2239] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:19.708812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:19.710640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:19.735699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eede4f8f84994806a6dec21c810ed0db'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.736431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eede4f8f84994806a6dec21c810ed0db'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.748637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eede4f8f84994806a6dec21c810ed0db'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.749343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eede4f8f84994806a6dec21c810ed0db'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.757565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eede4f8f84994806a6dec21c810ed0db'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:19.771100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1134/2240] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:19 2022] DELETE /identity/v3/users/eede4f8f84994806a6dec21c810ed0db => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:19.772171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe0260-03e9-4c32-bacc-1fe76d4f96bb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:19.822152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179c980-6b24-43b0-a3fa-08b7540214a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:19.822817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c980-6b24-43b0-a3fa-08b7540214a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:19.823949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c980-6b24-43b0-a3fa-08b7540214a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:19.824190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c980-6b24-43b0-a3fa-08b7540214a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:19.826072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1179c980-6b24-43b0-a3fa-08b7540214a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:19.893066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179c980-6b24-43b0-a3fa-08b7540214a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:19.894676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179c980-6b24-43b0-a3fa-08b7540214a7 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:19.900821 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:19.908925 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1107/2241] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:12:20.093137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.094997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:20.117401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768db9c-38c6-41b4-b395-0488cd0b4989 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.137048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.138644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.138928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.139204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] PATH_INFO: `/v3/projects/41ea6d47f0fd4d97a6c00145d6b51ec2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.140430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ea6d47f0fd4d97a6c00145d6b51ec2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.142376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.206936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ea6d47f0fd4d97a6c00145d6b51ec2', 'request_id': 'req-78b83939-3de6-4963-b4de-0f72eb50b4c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.214394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ea6d47f0fd4d97a6c00145d6b51ec2', 'request_id': 'req-78b83939-3de6-4963-b4de-0f72eb50b4c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.221569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ea6d47f0fd4d97a6c00145d6b51ec2', 'request_id': 'req-78b83939-3de6-4963-b4de-0f72eb50b4c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.233480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:20.239095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] The token cache is being invalidate because project 41ea6d47f0fd4d97a6c00145d6b51ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:20.239728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.240737 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.247069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1135/2242] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:20 2022] DELETE /identity/v3/projects/41ea6d47f0fd4d97a6c00145d6b51ec2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:20.248733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79edc06-c2e2-4b5d-9c98-3fa84c8ca338 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.249692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79edc06-c2e2-4b5d-9c98-3fa84c8ca338 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.250040 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79edc06-c2e2-4b5d-9c98-3fa84c8ca338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.273250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c79edc06-c2e2-4b5d-9c98-3fa84c8ca338 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:20.274460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c79edc06-c2e2-4b5d-9c98-3fa84c8ca338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:20.325957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.327512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:20.366573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1108/2243] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:20.375091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943275e1-b389-43df-aeb7-6a1a2def036f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.375376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943275e1-b389-43df-aeb7-6a1a2def036f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.375716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943275e1-b389-43df-aeb7-6a1a2def036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.396864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-943275e1-b389-43df-aeb7-6a1a2def036f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:20.398060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-943275e1-b389-43df-aeb7-6a1a2def036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:20.400711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b83939-3de6-4963-b4de-0f72eb50b4c4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.405706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.406274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.406853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.406950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1109/2244] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:20.407047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] PATH_INFO: `/v3/projects/37ef1826633a4dafb2ed1c9669ada260` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.407958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ef1826633a4dafb2ed1c9669ada260)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.409858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.410868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943275e1-b389-43df-aeb7-6a1a2def036f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.423313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943275e1-b389-43df-aeb7-6a1a2def036f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.431076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.431845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.432321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.433237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.433982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:20.434795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.436112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.449940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1110/2245] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:12:20.454266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.464633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c6cc3-e74d-4b5a-accf-b7093f2c7ddf admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.469948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ef1826633a4dafb2ed1c9669ada260', 'request_id': 'req-c32f1e90-80ef-45c3-acec-bcb8e6650237'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.478242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ef1826633a4dafb2ed1c9669ada260', 'request_id': 'req-c32f1e90-80ef-45c3-acec-bcb8e6650237'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.484822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ef1826633a4dafb2ed1c9669ada260', 'request_id': 'req-c32f1e90-80ef-45c3-acec-bcb8e6650237'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.499918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] The token cache is being invalidate because project 37ef1826633a4dafb2ed1c9669ada260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:20.500209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.501909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c32f1e90-80ef-45c3-acec-bcb8e6650237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:20.506531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1136/2246] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:20 2022] DELETE /identity/v3/projects/37ef1826633a4dafb2ed1c9669ada260 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:20.507827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889fd01-70c4-45ed-8693-2e92c9242070 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.508113 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889fd01-70c4-45ed-8693-2e92c9242070 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.510021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889fd01-70c4-45ed-8693-2e92c9242070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.530406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9889fd01-70c4-45ed-8693-2e92c9242070 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:20.531817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9889fd01-70c4-45ed-8693-2e92c9242070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:20.537107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.537720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.537999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.538679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.542920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.544975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.580283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1111/2247] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:20.581306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.582938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:20.613433 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1137/2248] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:20.621558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd96000-0ab7-4ddf-8961-9a6e9ec64f67 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.621839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd96000-0ab7-4ddf-8961-9a6e9ec64f67 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.622112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd96000-0ab7-4ddf-8961-9a6e9ec64f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.641351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7dd96000-0ab7-4ddf-8961-9a6e9ec64f67 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:20.642550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7dd96000-0ab7-4ddf-8961-9a6e9ec64f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:20.650936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b0ab-ed1f-4e3a-aaaa-09e37439ab65 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.652479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1138/2249] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:20.657541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.657759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd96000-0ab7-4ddf-8961-9a6e9ec64f67 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.658161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.658552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.658862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.659608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.662059 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.671156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd96000-0ab7-4ddf-8961-9a6e9ec64f67 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.677481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:20.677906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.678804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.679085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.679448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.680067 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:20.680368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.682095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.693596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1112/2250] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:20.694732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.695762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1139/2251] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:12:20.699955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.704345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d17c83-9654-494e-9464-d2802587e76b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.708907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.709494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.709700 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b0783-706b-4906-9481-4b6706f3b4b4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.709811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.710017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.710648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.712522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.715337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.716042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.716387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.716742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.717432 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.720553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.723548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1113/2252] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:20.727441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.736838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:20.738701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a856fd-0b7e-4847-ae22-cbeaf3670947 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.744012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.744651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.744961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.745940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.746887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.749047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.761381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1114/2253] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:20.767604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1140/2254] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:20.767713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.768278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.777895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016b548-8c22-4fbd-ad2e-3d72e71c5352 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.849796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a9581-3045-4921-ae9d-e9655b76dfcd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.850837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a609979-f352-45fe-b97b-4e14b8b6d84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.851547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a609979-f352-45fe-b97b-4e14b8b6d84b admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.851831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a609979-f352-45fe-b97b-4e14b8b6d84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.852106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a609979-f352-45fe-b97b-4e14b8b6d84b admin admin] PATH_INFO: `/v3/projects/0d8e6dc81ab84e5e888c6b360daa336a/users/0745b6df0fed498ba61ff88ae18f72e1/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.861937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:20.862561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.862837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.863131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.865291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.867666 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.883241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a609979-f352-45fe-b97b-4e14b8b6d84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8e6dc81ab84e5e888c6b360daa336a, user_id=0745b6df0fed498ba61ff88ae18f72e1, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:20.886535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a609979-f352-45fe-b97b-4e14b8b6d84b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:20.902457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1115/2255] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:20 2022] PUT /identity/v3/projects/0d8e6dc81ab84e5e888c6b360daa336a/users/0745b6df0fed498ba61ff88ae18f72e1/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:20.921793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1141/2256] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:20.921968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a52573-c384-408f-87a2-d1d463c72692 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:20.921968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a52573-c384-408f-87a2-d1d463c72692 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:20.921968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a52573-c384-408f-87a2-d1d463c72692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:20.922772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:20.943842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb96b0-b693-4b36-8f13-b3d8e4d4da02 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:20.963115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b7a52573-c384-408f-87a2-d1d463c72692 None None] MFA Rules not processed for user `0745b6df0fed498ba61ff88ae18f72e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:20.965457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b7a52573-c384-408f-87a2-d1d463c72692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:21.000150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.000859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.001164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.001435 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.002071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.003800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.015303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1142/2257] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:21.019558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.039170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ced86-7b95-449d-a645-69d21847ec97 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.045373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.046003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.046337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.046556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.047215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.049249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.062235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1116/2258] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:21.063745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1143/2259] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:21.066927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a52573-c384-408f-87a2-d1d463c72692 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.067234 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.077464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ffff7-99da-417c-99ec-dd988701be82 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.077999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a52573-c384-408f-87a2-d1d463c72692 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.082104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.082610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0d2ed-145d-4df7-8439-ec02ffa70ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.082750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.082967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.083242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.083341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d2ed-145d-4df7-8439-ec02ffa70ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.083566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d2ed-145d-4df7-8439-ec02ffa70ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.083843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d2ed-145d-4df7-8439-ec02ffa70ab0 admin admin] PATH_INFO: `/v3/projects/ff0c216a9fee4a5986051c797d877706/users/46509a2b78c24e67b2186678a13228aa/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.083948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.085832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.099655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0d2ed-145d-4df7-8439-ec02ffa70ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0c216a9fee4a5986051c797d877706, user_id=46509a2b78c24e67b2186678a13228aa, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.102331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0d2ed-145d-4df7-8439-ec02ffa70ab0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.114559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1144/2260] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:21 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:21.115845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1117/2261] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:21 2022] PUT /identity/v3/projects/ff0c216a9fee4a5986051c797d877706/users/46509a2b78c24e67b2186678a13228aa/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:21.118661 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.121300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.121751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.123554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.142003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:21.143205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:21.160885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:21.168771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:21.187064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b945e-cba8-46ea-8f49-c531840632af admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.192106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.192717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.192995 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.193265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.193889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.195862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.206775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1118/2262] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:21.217494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.218901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:21.219014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1145/2263] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:21 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:21.222625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.232916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9fdc7-a35b-4c43-ae3f-a9e5afeb72cc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.237610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.238201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.238480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.238751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.239393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.241060 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.251550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1146/2264] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:21.255573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.268068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5d701-30c9-4815-a380-143b85adb7f4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.273671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.273982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.274259 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.274531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] PATH_INFO: `/v3/projects/b347c22b2a40414a8f3f20bfad06b506/users/8987010ccb42437495df035836234183/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.283890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807878-35b4-4bd2-b736-9172264ff160 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.287515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.288117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.288538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.288770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.292555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b347c22b2a40414a8f3f20bfad06b506, user_id=8987010ccb42437495df035836234183, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.295247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.310667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1147/2265] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:21 2022] PUT /identity/v3/projects/b347c22b2a40414a8f3f20bfad06b506/users/8987010ccb42437495df035836234183/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:21.313994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.313994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.314928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.324079 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1119/2266] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:21.386112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f927c-4c26-4cc0-bf54-53c237b0835d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.391655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b47f-1c88-4369-ad55-1158e3b5a0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.392260 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b47f-1c88-4369-ad55-1158e3b5a0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.392534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b47f-1c88-4369-ad55-1158e3b5a0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.392800 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b47f-1c88-4369-ad55-1158e3b5a0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.393458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b47f-1c88-4369-ad55-1158e3b5a0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.395014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b47f-1c88-4369-ad55-1158e3b5a0b5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.406847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1148/2267] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:21.411155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.422858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69cc5b-a7d6-4cb2-b485-edf2811cc566 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.427688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.428425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.428771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.429255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] PATH_INFO: `/v3/projects/b347c22b2a40414a8f3f20bfad06b506/users/8987010ccb42437495df035836234183/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.431225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b347c22b2a40414a8f3f20bfad06b506, user_id=8987010ccb42437495df035836234183, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.434828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.468620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1120/2268] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:21 2022] PUT /identity/v3/projects/b347c22b2a40414a8f3f20bfad06b506/users/8987010ccb42437495df035836234183/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:21.472390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce874-7110-489c-8872-5d4a2cfd57aa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.473290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce874-7110-489c-8872-5d4a2cfd57aa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.473766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce874-7110-489c-8872-5d4a2cfd57aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.506401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-104ce874-7110-489c-8872-5d4a2cfd57aa None None] MFA Rules not processed for user `8987010ccb42437495df035836234183`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:21.507868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-104ce874-7110-489c-8872-5d4a2cfd57aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:21.582162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1149/2269] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:21.594380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.596184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:21.683635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf890d-2510-45e0-9ed5-0cdffc36740e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.688044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657a52d-931f-482c-8d42-ae95a2d2c373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.688919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657a52d-931f-482c-8d42-ae95a2d2c373 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.689199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657a52d-931f-482c-8d42-ae95a2d2c373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.689468 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657a52d-931f-482c-8d42-ae95a2d2c373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.709616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657a52d-931f-482c-8d42-ae95a2d2c373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.711694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657a52d-931f-482c-8d42-ae95a2d2c373 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.728379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1121/2270] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:21.766742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce874-7110-489c-8872-5d4a2cfd57aa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:21.790131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:21.850573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce874-7110-489c-8872-5d4a2cfd57aa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:21.855748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:21.856427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.856705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.856974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] PATH_INFO: `/v3/users/0745b6df0fed498ba61ff88ae18f72e1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.858114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0745b6df0fed498ba61ff88ae18f72e1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:21.860507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:21.910623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0745b6df0fed498ba61ff88ae18f72e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:21.911313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0745b6df0fed498ba61ff88ae18f72e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:21.924558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0745b6df0fed498ba61ff88ae18f72e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:21.925252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0745b6df0fed498ba61ff88ae18f72e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:21.932929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0745b6df0fed498ba61ff88ae18f72e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:21.946836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1150/2271] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:21 2022] DELETE /identity/v3/users/0745b6df0fed498ba61ff88ae18f72e1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:21.952025 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb64fe-b29b-4635-a726-6b0c621b2ebe None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:21.952366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb64fe-b29b-4635-a726-6b0c621b2ebe None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:21.952709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb64fe-b29b-4635-a726-6b0c621b2ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:21.976328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c0eb64fe-b29b-4635-a726-6b0c621b2ebe None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:21.977548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c0eb64fe-b29b-4635-a726-6b0c621b2ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:22.040260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:22.058131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1122/2272] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:22.068925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:22.070509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:22.093879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:22.094196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:22.094469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:22.147766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] MFA Rules not processed for user `46509a2b78c24e67b2186678a13228aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:22.150444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:22.172558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f7d7-e653-488f-b6bf-02836dab2c8d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:22.185621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:22.186265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:22.186560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:22.186807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:22.222247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:22.223965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:22.235050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1151/2273] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:22.245918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1123/2274] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:22.256739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:22.258341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:22.320337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:22.353175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37669a-75f0-4538-b6e3-5915b704410c service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:22.359326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:22.360094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:22.360459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:22.361277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:22.375099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:22.377609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:22.391294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1152/2275] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:22.537714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:22.539168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:22.553756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a3edb-4838-4b0e-85db-833e248b29d5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:22.559651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:22.560351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:22.561253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:22.561531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] PATH_INFO: `/v3/projects/0d8e6dc81ab84e5e888c6b360daa336a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:22.562878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8e6dc81ab84e5e888c6b360daa336a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:22.565232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:22.621124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8e6dc81ab84e5e888c6b360daa336a', 'request_id': 'req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.630316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8e6dc81ab84e5e888c6b360daa336a', 'request_id': 'req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.636859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8e6dc81ab84e5e888c6b360daa336a', 'request_id': 'req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.648792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] The token cache is being invalidate because project 0d8e6dc81ab84e5e888c6b360daa336a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:22.649047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.649714 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.651301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1124/2276] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:22 2022] DELETE /identity/v3/projects/0d8e6dc81ab84e5e888c6b360daa336a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:22.655943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:22.668481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398c2-c93f-468c-b124-f89dcc85047b service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:22.742030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:22.742614 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:22.742946 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:22.743257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] PATH_INFO: `/v3/users/8987010ccb42437495df035836234183` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:22.744378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8987010ccb42437495df035836234183)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:22.746903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:22.793124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8987010ccb42437495df035836234183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.793811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8987010ccb42437495df035836234183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.806814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8987010ccb42437495df035836234183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.807203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8987010ccb42437495df035836234183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.815121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-23c9e508-6b35-4158-99f0-a6c0987de879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8987010ccb42437495df035836234183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:22.829588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1153/2277] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:22 2022] DELETE /identity/v3/users/8987010ccb42437495df035836234183 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:23.216661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:23.218548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:23.235270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71a508-45fa-4f7e-a35d-01e34ca40cb1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:23.336931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:23.337780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.338524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.338524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] PATH_INFO: `/v3/projects/b347c22b2a40414a8f3f20bfad06b506` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.340547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b347c22b2a40414a8f3f20bfad06b506)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:23.342469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:23.353970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:23.410158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b347c22b2a40414a8f3f20bfad06b506', 'request_id': 'req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:23.419779 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b347c22b2a40414a8f3f20bfad06b506', 'request_id': 'req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:23.426715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b347c22b2a40414a8f3f20bfad06b506', 'request_id': 'req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:23.439736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] The token cache is being invalidate because project b347c22b2a40414a8f3f20bfad06b506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:23.440118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:23.440865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-558e1bd5-c4c9-4ec9-acc7-25b09c673e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:23.442783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1125/2278] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:23 2022] DELETE /identity/v3/projects/b347c22b2a40414a8f3f20bfad06b506 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:23.447365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e347-bd80-49e9-99da-8abb360372fc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.447686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e347-bd80-49e9-99da-8abb360372fc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.448038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e347-bd80-49e9-99da-8abb360372fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.467845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-52c0e347-bd80-49e9-99da-8abb360372fc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:23.471976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-52c0e347-bd80-49e9-99da-8abb360372fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:23.538765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1154/2279] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:23.546915 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f381f-f0e9-4960-9b1a-2a3ff891bac4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.547390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f381f-f0e9-4960-9b1a-2a3ff891bac4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.547524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f381f-f0e9-4960-9b1a-2a3ff891bac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.568078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-428f381f-f0e9-4960-9b1a-2a3ff891bac4 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:23.569285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-428f381f-f0e9-4960-9b1a-2a3ff891bac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:23.578345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1126/2280] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:23.582942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0e347-bd80-49e9-99da-8abb360372fc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:23.588140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:23.595595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0e347-bd80-49e9-99da-8abb360372fc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:23.601239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:23.601845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.602330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.602629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.603458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:23.603772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:23.605824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:23.617976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1155/2281] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:12:23.622854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f381f-f0e9-4960-9b1a-2a3ff891bac4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:23.632204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f381f-f0e9-4960-9b1a-2a3ff891bac4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:23.637830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:23.638436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.638721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.638991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.639654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:23.641570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:23.680675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1127/2282] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:23 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:23.684660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:23.694858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020001e-f116-44b2-befe-c4cf200543e4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:23.753848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c61d63-28ce-4016-9b37-c8dbbcba28cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:23.754469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61d63-28ce-4016-9b37-c8dbbcba28cc admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.754738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61d63-28ce-4016-9b37-c8dbbcba28cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.755015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61d63-28ce-4016-9b37-c8dbbcba28cc admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.755680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c61d63-28ce-4016-9b37-c8dbbcba28cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:23.757592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c61d63-28ce-4016-9b37-c8dbbcba28cc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:23.788049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1156/2283] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:23 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:23.792116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:23.805665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281026b-b10d-4e21-92cd-492743ea16a7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.806023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281026b-b10d-4e21-92cd-492743ea16a7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.806276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281026b-b10d-4e21-92cd-492743ea16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.806932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999db18b-3757-446c-b36e-4a91a5a84a88 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:23.814457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:23.815645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.816138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.816903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.817839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:23.819837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:23.834066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1128/2284] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:23.838716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:23.849065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c281026b-b10d-4e21-92cd-492743ea16a7 None None] MFA Rules not processed for user `46509a2b78c24e67b2186678a13228aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:23.850345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c281026b-b10d-4e21-92cd-492743ea16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:23.851594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf011-89ed-446a-9461-a7a28edb5248 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:23.857509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:23.858149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.858450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.858726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.859378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:23.861019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:23.874976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1129/2285] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:23.876325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:23.888230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c1e5a-10af-406e-9e2c-6ab15b17fc34 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:23.894378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:23.895037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.895331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.895619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] PATH_INFO: `/v3/projects/c2723d7d9ae444da8dbcf11b72411cab/users/56912ae52b7f4f61b4ca2d7c8e64168e/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.913254 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2723d7d9ae444da8dbcf11b72411cab, user_id=56912ae52b7f4f61b4ca2d7c8e64168e, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:23.916327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:23.916538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1157/2286] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:23.936267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1130/2287] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:23 2022] PUT /identity/v3/projects/c2723d7d9ae444da8dbcf11b72411cab/users/56912ae52b7f4f61b4ca2d7c8e64168e/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:23.947265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeacd9-baf5-465e-bd47-41fc966f6639 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:23.947265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeacd9-baf5-465e-bd47-41fc966f6639 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:23.947479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeacd9-baf5-465e-bd47-41fc966f6639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:23.976647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-eaaeacd9-baf5-465e-bd47-41fc966f6639 None None] MFA Rules not processed for user `56912ae52b7f4f61b4ca2d7c8e64168e`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:23.977924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eaaeacd9-baf5-465e-bd47-41fc966f6639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:24.042799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1158/2288] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:24.047960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.116578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e799ed-fe1b-4f78-ae7b-a17139cd90ff admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.123843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.124507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.124780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.125047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.125679 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.127768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:24.173055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1131/2289] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:24 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:24.177112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeacd9-baf5-465e-bd47-41fc966f6639 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.188758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeacd9-baf5-465e-bd47-41fc966f6639 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.198709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:24.250106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.250739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.251009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.251295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.251937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.253894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:24.281137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1159/2290] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:24 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:24.282320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.294685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372938a0-0347-4b99-bded-019fa3912b27 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.299838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.300467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.300755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.301042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.301796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.303352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:24.305829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:24.316996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1132/2291] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:24.320964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.331193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40361826-daa8-45db-8e7f-2ae131fe83e5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.336483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.337151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.337422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.337689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] PATH_INFO: `/v3/projects/943ebefba5a24cceb77930f394dd0dce/users/0070752426144291a8b8ed8c1c668a87/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.352559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] RBAC: Authorizing `identity:create_grant(project_id=943ebefba5a24cceb77930f394dd0dce, user_id=0070752426144291a8b8ed8c1c668a87, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.356051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:24.369068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1160/2292] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:24 2022] PUT /identity/v3/projects/943ebefba5a24cceb77930f394dd0dce/users/0070752426144291a8b8ed8c1c668a87/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:24.374125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.384207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dfdbb-bce5-4911-a02e-bf4b46cb23d5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.446108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3aeb3-18f6-4d01-a689-8931580b2b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.446744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3aeb3-18f6-4d01-a689-8931580b2b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.447046 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3aeb3-18f6-4d01-a689-8931580b2b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.447324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3aeb3-18f6-4d01-a689-8931580b2b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.448060 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3aeb3-18f6-4d01-a689-8931580b2b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.454159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3aeb3-18f6-4d01-a689-8931580b2b7d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:24.494202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1133/2293] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:24.499072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.520602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7a2f0-5feb-4dcf-b2ea-e6e98a9e81da admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.540622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.541301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.541577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.543188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] PATH_INFO: `/v3/projects/943ebefba5a24cceb77930f394dd0dce/users/0070752426144291a8b8ed8c1c668a87/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.545238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=943ebefba5a24cceb77930f394dd0dce, user_id=0070752426144291a8b8ed8c1c668a87, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.549199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:24.585809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1161/2294] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:24 2022] PUT /identity/v3/projects/943ebefba5a24cceb77930f394dd0dce/users/0070752426144291a8b8ed8c1c668a87/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:24.601238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ecf23-bf2b-4335-87fe-4b6cbabaf1c9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.601729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ecf23-bf2b-4335-87fe-4b6cbabaf1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.601813 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ecf23-bf2b-4335-87fe-4b6cbabaf1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.632663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7a4ecf23-bf2b-4335-87fe-4b6cbabaf1c9 None None] MFA Rules not processed for user `0070752426144291a8b8ed8c1c668a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:24.633916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7a4ecf23-bf2b-4335-87fe-4b6cbabaf1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:24.710657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1134/2295] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:24.723724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.725636 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:24.808342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4204a4-a9bd-4d89-97c7-67ce5a63090e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.811658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca116ab-6017-4a8e-98c8-50e1d30df42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.812264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca116ab-6017-4a8e-98c8-50e1d30df42a service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.812541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca116ab-6017-4a8e-98c8-50e1d30df42a service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.812820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca116ab-6017-4a8e-98c8-50e1d30df42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.822336 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca116ab-6017-4a8e-98c8-50e1d30df42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.824024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca116ab-6017-4a8e-98c8-50e1d30df42a service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:24.833711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1162/2296] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:12:24.908689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ecf23-bf2b-4335-87fe-4b6cbabaf1c9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:24.977650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ecf23-bf2b-4335-87fe-4b6cbabaf1c9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:24.982899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:24.983595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:24.983876 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:24.984148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] PATH_INFO: `/v3/users/56912ae52b7f4f61b4ca2d7c8e64168e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:24.985272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56912ae52b7f4f61b4ca2d7c8e64168e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:24.987203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:25.008554 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:25.034705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56912ae52b7f4f61b4ca2d7c8e64168e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.053775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56912ae52b7f4f61b4ca2d7c8e64168e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.064161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56912ae52b7f4f61b4ca2d7c8e64168e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.064923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56912ae52b7f4f61b4ca2d7c8e64168e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.065657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56912ae52b7f4f61b4ca2d7c8e64168e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.080088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1135/2297] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:24 2022] DELETE /identity/v3/users/56912ae52b7f4f61b4ca2d7c8e64168e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:25.084777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:25.085064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:25.085341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:25.103845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:25.105812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:25.163027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1163/2298] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:25.173436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:25.174838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:25.233389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d19ff-8a58-415d-be85-87de7e282814 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:25.237027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:25.237663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:25.238216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:25.238491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:25.248308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:25.249736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:25.259669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1136/2299] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:25.565808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:25.567243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:25.581455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a19ed-0c29-44e4-9a23-e9333f7886a8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:25.589839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:25.598808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:25.599107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:25.599361 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] PATH_INFO: `/v3/projects/c2723d7d9ae444da8dbcf11b72411cab` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:25.616079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2723d7d9ae444da8dbcf11b72411cab)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:25.618468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:25.621329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:25.689091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2723d7d9ae444da8dbcf11b72411cab', 'request_id': 'req-17294e56-e7db-406a-99c7-e369d2c828f3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.699571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2723d7d9ae444da8dbcf11b72411cab', 'request_id': 'req-17294e56-e7db-406a-99c7-e369d2c828f3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.704445 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2723d7d9ae444da8dbcf11b72411cab', 'request_id': 'req-17294e56-e7db-406a-99c7-e369d2c828f3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.718917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] The token cache is being invalidate because project c2723d7d9ae444da8dbcf11b72411cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:25.719206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.719905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.721709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1164/2300] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:25 2022] DELETE /identity/v3/projects/c2723d7d9ae444da8dbcf11b72411cab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:25.725368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:25.735557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d33e-9059-43f8-bc92-9b8efc638552 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:25.801873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:25.802533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:25.802927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:25.803128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] PATH_INFO: `/v3/users/0070752426144291a8b8ed8c1c668a87` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:25.804331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0070752426144291a8b8ed8c1c668a87)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:25.806387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:25.852330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:25.856323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0070752426144291a8b8ed8c1c668a87'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.869661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0070752426144291a8b8ed8c1c668a87'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.877791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0070752426144291a8b8ed8c1c668a87'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.878516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0070752426144291a8b8ed8c1c668a87'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.879115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1a338f2-c8f1-43cb-9fcf-500ce32df505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0070752426144291a8b8ed8c1c668a87'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:25.892771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1137/2301] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:25 2022] DELETE /identity/v3/users/0070752426144291a8b8ed8c1c668a87 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:26.177386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.179111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:26.193913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17294e56-e7db-406a-99c7-e369d2c828f3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:26.252179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:26.252805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.253083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.253356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] PATH_INFO: `/v3/projects/943ebefba5a24cceb77930f394dd0dce` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.254463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=943ebefba5a24cceb77930f394dd0dce)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:26.256426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:26.304667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943ebefba5a24cceb77930f394dd0dce', 'request_id': 'req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:26.311475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943ebefba5a24cceb77930f394dd0dce', 'request_id': 'req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:26.317232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943ebefba5a24cceb77930f394dd0dce', 'request_id': 'req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:26.337285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] The token cache is being invalidate because project 943ebefba5a24cceb77930f394dd0dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:26.337659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:26.338441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1479ad6e-41f4-4d78-9dc8-e0c573686ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:26.341013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1165/2302] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:26 2022] DELETE /identity/v3/projects/943ebefba5a24cceb77930f394dd0dce => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:26.345735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85f36-d2df-46dd-9485-7e09201d78c3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.346086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85f36-d2df-46dd-9485-7e09201d78c3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.346361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85f36-d2df-46dd-9485-7e09201d78c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.369510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-fac85f36-d2df-46dd-9485-7e09201d78c3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:26.370692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fac85f36-d2df-46dd-9485-7e09201d78c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:26.430889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1138/2303] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:26.439326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d071d-191f-4137-99c1-bab3a5f101c5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.439718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d071d-191f-4137-99c1-bab3a5f101c5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.440020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d071d-191f-4137-99c1-bab3a5f101c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.459246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-097d071d-191f-4137-99c1-bab3a5f101c5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:26.460760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-097d071d-191f-4137-99c1-bab3a5f101c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:26.469168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1166/2304] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:26.473375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac85f36-d2df-46dd-9485-7e09201d78c3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.483726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac85f36-d2df-46dd-9485-7e09201d78c3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:26.488414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:26.489038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.489316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.489585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.490227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:26.490552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:26.492245 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:26.504021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1139/2305] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:12:26.508257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d071d-191f-4137-99c1-bab3a5f101c5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.518020 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d071d-191f-4137-99c1-bab3a5f101c5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:26.522750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:26.523354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.523637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.523904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.524514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:26.527235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:26.541732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:26.560672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1167/2306] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:26.562580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.572765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369635-38d8-454b-ab10-11d551043cc3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:26.629924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:26.630458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.630740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.631007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.631675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:26.633571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:26.662671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1140/2307] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:26 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:26.666521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.677499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bffc9-c51c-424b-9298-95f5a811fcf3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:26.682124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:26.683328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.683625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.683896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.684533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:26.686118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:26.701816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1168/2308] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:26.704210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.720685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955a82a-1fe9-4959-812e-8908234aae41 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:26.727039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5d933-281b-4751-b0b7-c56cae1dd517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:26.727662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5d933-281b-4751-b0b7-c56cae1dd517 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.727905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5d933-281b-4751-b0b7-c56cae1dd517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.728200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5d933-281b-4751-b0b7-c56cae1dd517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.728906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5d933-281b-4751-b0b7-c56cae1dd517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:26.730565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5d933-281b-4751-b0b7-c56cae1dd517 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:26.742527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1141/2309] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:26.746707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.757334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3786d-514d-4460-9c05-2faae469bc10 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:26.762920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:26.763618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.763898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.764173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] PATH_INFO: `/v3/projects/6b2d094b4e244aa395daeffef8e6d5e0/users/5ef4f19b84b84f20883f1e4d37ab8102/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.780471 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2d094b4e244aa395daeffef8e6d5e0, user_id=5ef4f19b84b84f20883f1e4d37ab8102, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:26.783145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:26.804397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1169/2310] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:26 2022] PUT /identity/v3/projects/6b2d094b4e244aa395daeffef8e6d5e0/users/5ef4f19b84b84f20883f1e4d37ab8102/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:26.815477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6a9bc-1bdd-41e0-babf-84a805ab25ca None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:26.816533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6a9bc-1bdd-41e0-babf-84a805ab25ca None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:26.816533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6a9bc-1bdd-41e0-babf-84a805ab25ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:26.863690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5bc6a9bc-1bdd-41e0-babf-84a805ab25ca None None] MFA Rules not processed for user `5ef4f19b84b84f20883f1e4d37ab8102`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:26.864899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5bc6a9bc-1bdd-41e0-babf-84a805ab25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:26.879048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:26.942395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1142/2311] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:26.955350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:26.957248 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:27.038932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1c781-fd4d-45da-8baf-4ad951195d03 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:27.045149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc37d4-64d8-4d0a-b02f-94f8fb31c0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:27.046100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc37d4-64d8-4d0a-b02f-94f8fb31c0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:27.046374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc37d4-64d8-4d0a-b02f-94f8fb31c0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:27.046668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc37d4-64d8-4d0a-b02f-94f8fb31c0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:27.065148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc37d4-64d8-4d0a-b02f-94f8fb31c0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:27.068981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc37d4-64d8-4d0a-b02f-94f8fb31c0a1 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:27.080592 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1170/2312] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:29.950095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:29.951591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:29.952089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:29.972094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] MFA Rules not processed for user `415b9de52afe4122b65ce6adeaab16b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:29.973321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:30.030762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1143/2313] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:37.075656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:40.023150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=45 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:40.964444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5114a3-a0f6-4d80-be07-a7b25989313b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:40.965015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5114a3-a0f6-4d80-be07-a7b25989313b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:40.965015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5114a3-a0f6-4d80-be07-a7b25989313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:40.989293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cf5114a3-a0f6-4d80-be07-a7b25989313b None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:40.990977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cf5114a3-a0f6-4d80-be07-a7b25989313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:41.059776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1171/2314] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:12:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:41.076599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:41.079671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:41.196895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3bf0c-69a1-423c-a0d4-565acfd3106d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:41.203613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:41.204326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:41.204701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:41.205024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:41.214469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:41.216277 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:41.224863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1144/2315] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 08:12:41.638781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d24f-9a3c-4c50-9bf4-49105345849f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:41.639398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d24f-9a3c-4c50-9bf4-49105345849f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:41.639692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d24f-9a3c-4c50-9bf4-49105345849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:41.660977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9bc1d24f-9a3c-4c50-9bf4-49105345849f None None] MFA Rules not processed for user `b83b1a254074456897dcb9430e29d4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:41.662206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9bc1d24f-9a3c-4c50-9bf4-49105345849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:41.743529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1172/2316] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:49.224050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:49.301328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680dacf-f88a-4a99-8f49-ca0a4990247e service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:49.309570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:49.311282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:49.312050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:49.312419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] PATH_INFO: `/v3/users/5ef4f19b84b84f20883f1e4d37ab8102` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:49.314977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef4f19b84b84f20883f1e4d37ab8102)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:49.329459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:49.477786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef4f19b84b84f20883f1e4d37ab8102'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:49.511280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef4f19b84b84f20883f1e4d37ab8102'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:49.520147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef4f19b84b84f20883f1e4d37ab8102'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:49.520901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef4f19b84b84f20883f1e4d37ab8102'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:49.521605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef4f19b84b84f20883f1e4d37ab8102'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:49.551014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1145/2317] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:12:49 2022] DELETE /identity/v3/users/5ef4f19b84b84f20883f1e4d37ab8102 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:49.555316 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31a098-c8c7-4547-8909-048ef9f532b3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:49.556809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31a098-c8c7-4547-8909-048ef9f532b3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:49.557634 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31a098-c8c7-4547-8909-048ef9f532b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:49.624333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7e31a098-c8c7-4547-8909-048ef9f532b3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:49.625839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7e31a098-c8c7-4547-8909-048ef9f532b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:49.768843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1173/2318] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:49.778081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:49.779623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:49.800054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:49.863494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a207-95d9-41ec-b45a-df1d9783a712 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:49.868709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:49.869960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:49.870480 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:49.870963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:49.882121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:49.883965 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:49.900065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1146/2319] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:50.201612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c93ed-da11-48c7-8d55-5ba2a84b17f3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:50.201901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c93ed-da11-48c7-8d55-5ba2a84b17f3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:50.202179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c93ed-da11-48c7-8d55-5ba2a84b17f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:50.238379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-672c93ed-da11-48c7-8d55-5ba2a84b17f3 None None] MFA Rules not processed for user `b531d7ca59814d359b30264d2c9f7116`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:50.241556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-672c93ed-da11-48c7-8d55-5ba2a84b17f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:50.337152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:50.379167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1174/2320] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:50.627108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:50.631029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:50.672404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07621885-2e4b-4c24-8865-a2d0384b9f58 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:50.677856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:50.679052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:50.679508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:50.679794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] PATH_INFO: `/v3/projects/6b2d094b4e244aa395daeffef8e6d5e0` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:50.681107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2d094b4e244aa395daeffef8e6d5e0)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:50.684038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:50.797021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2d094b4e244aa395daeffef8e6d5e0', 'request_id': 'req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:50.815600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2d094b4e244aa395daeffef8e6d5e0', 'request_id': 'req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:50.825163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2d094b4e244aa395daeffef8e6d5e0', 'request_id': 'req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:50.850023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] The token cache is being invalidate because project 6b2d094b4e244aa395daeffef8e6d5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:12:50.850319 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:50.851074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d941aac2-6f53-4b61-83cc-dc9bd7f4ec74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:12:50.852986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1147/2321] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:12:50 2022] DELETE /identity/v3/projects/6b2d094b4e244aa395daeffef8e6d5e0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:50.859256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6801e-2154-4148-96c0-003502379421 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:50.860030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6801e-2154-4148-96c0-003502379421 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:50.860030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6801e-2154-4148-96c0-003502379421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:50.884018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-16d6801e-2154-4148-96c0-003502379421 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:50.886392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-16d6801e-2154-4148-96c0-003502379421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:51.032649 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1175/2322] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:51.043612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95631b5-b286-4d92-afe1-2969152d9cf8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.044195 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95631b5-b286-4d92-afe1-2969152d9cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.049021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95631b5-b286-4d92-afe1-2969152d9cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.090335 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d95631b5-b286-4d92-afe1-2969152d9cf8 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:51.093542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d95631b5-b286-4d92-afe1-2969152d9cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:51.111835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1148/2323] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:12:51.120823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6801e-2154-4148-96c0-003502379421 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:51.136224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6801e-2154-4148-96c0-003502379421 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:51.156258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:51.158813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.160046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.160475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.161291 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:12:51.162380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:51.164871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:51.202380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1176/2324] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:12:51.203516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95631b5-b286-4d92-afe1-2969152d9cf8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:51.217561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95631b5-b286-4d92-afe1-2969152d9cf8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:51.229527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:51.232899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.233394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.233670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.234309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:51.236269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:51.314782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1149/2325] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:51 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:51.318687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:51.330602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aec19-e68b-4041-9991-d36d0832c9bf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:51.433377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:51.433913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.434308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.437679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.439105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:51.441084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:51.472568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1177/2326] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:51 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:12:51.473839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:51.489343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a4d00-1071-46f6-b845-e7d7e667b46a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:51.510474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:51.512616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.512968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.514284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.515042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:51.519690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:51.550102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1150/2327] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:51.552001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:51.565506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322906b9-f8a1-4863-a7a6-7ead9262ded5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:51.590525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0fe3f-d29c-425e-8794-75cec0a0e4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:51.591313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0fe3f-d29c-425e-8794-75cec0a0e4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.591626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0fe3f-d29c-425e-8794-75cec0a0e4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.591911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0fe3f-d29c-425e-8794-75cec0a0e4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.595309 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0fe3f-d29c-425e-8794-75cec0a0e4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:51.600047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0fe3f-d29c-425e-8794-75cec0a0e4e4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:51.633767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1178/2328] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:12:51.638250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:51.649458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebf915-2c9a-4b33-a013-6544d5a367d1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:51.656108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:51.657073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.657562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.658047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] PATH_INFO: `/v3/projects/eff7843b47d94d9d96b23e659a61e2ae/users/d4e3d425e2e54e4d879ab4399f914361/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.680953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff7843b47d94d9d96b23e659a61e2ae, user_id=d4e3d425e2e54e4d879ab4399f914361, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:51.686385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:51.711136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1151/2329] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:51 2022] PUT /identity/v3/projects/eff7843b47d94d9d96b23e659a61e2ae/users/d4e3d425e2e54e4d879ab4399f914361/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:12:51.722148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e3cd-221a-4345-8e5c-7b5a11914fd2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.722428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e3cd-221a-4345-8e5c-7b5a11914fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.722701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e3cd-221a-4345-8e5c-7b5a11914fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.746593 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6249e3cd-221a-4345-8e5c-7b5a11914fd2 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:51.747862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6249e3cd-221a-4345-8e5c-7b5a11914fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:51.851442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1179/2330] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:51.858539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:51.860616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:51.911883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:51.953931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57b9c-b31a-451e-a4cc-050a5ad43b52 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:51.961903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:51.962757 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:51.962947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:51.963870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:51.975686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:51.977141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:52.002203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1152/2331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:12:58.506297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96c04-69aa-421f-ac05-602340449c44 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:58.506867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96c04-69aa-421f-ac05-602340449c44 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:58.507048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96c04-69aa-421f-ac05-602340449c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:58.519108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:12:58.562332 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e7f96c04-69aa-421f-ac05-602340449c44 None None] MFA Rules not processed for user `d4e3d425e2e54e4d879ab4399f914361`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:12:58.563573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e7f96c04-69aa-421f-ac05-602340449c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:12:58.655468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1180/2332] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:12:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:12:58.659638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:58.670658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09b84-d24f-4b18-b1b0-5fc922a715b2 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:58.675606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:58.676205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:58.676829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:58.677328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:58.678150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:58.680296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:58.729860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1153/2333] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:12:58 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:58.733807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f96c04-69aa-421f-ac05-602340449c44 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:58.757329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f96c04-69aa-421f-ac05-602340449c44 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:58.850760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:58.852086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:58.853083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:58.855876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:58.856568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:58.858533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:58.919357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1181/2334] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:12:58 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:12:58.926843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:58.948509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c28ac-5d3c-4a47-92f4-601cdd9f31e5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:58.954489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:58.955196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:58.955598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:58.956028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:58.956676 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:58.958505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:58.972188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1154/2335] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:58.976574 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:58.993609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80807ecd-29df-45f0-bfcc-4389f9ab58a6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:59.000684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:59.001576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:59.008103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:59.008594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] PATH_INFO: `/v3/projects/76d68afeb0874e2cbbcc8a989993f6a1/users/4d16aa4d3b124d6494e7d761ac9e5ca2/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:59.036662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d68afeb0874e2cbbcc8a989993f6a1, user_id=4d16aa4d3b124d6494e7d761ac9e5ca2, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:59.040303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:59.057192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1182/2336] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:58 2022] PUT /identity/v3/projects/76d68afeb0874e2cbbcc8a989993f6a1/users/4d16aa4d3b124d6494e7d761ac9e5ca2/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:12:59.061275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:59.081549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8b97e-12b1-4e6b-9380-1695b4fc195f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:59.155644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039da82-2136-42d6-bcdf-cdb48eaa0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:59.156376 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039da82-2136-42d6-bcdf-cdb48eaa0863 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:59.156750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039da82-2136-42d6-bcdf-cdb48eaa0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:59.157122 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039da82-2136-42d6-bcdf-cdb48eaa0863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:59.157914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039da82-2136-42d6-bcdf-cdb48eaa0863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:59.159958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039da82-2136-42d6-bcdf-cdb48eaa0863 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:59.173472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1155/2337] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:12:59.177663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:12:59.189109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3b137-dfda-40f5-abe9-636ac2ecfbad admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:12:59.194567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4fcff-fd6a-48da-88f7-2dce23c1ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:12:59.195339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4fcff-fd6a-48da-88f7-2dce23c1ccb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:12:59.195723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4fcff-fd6a-48da-88f7-2dce23c1ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:12:59.196063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4fcff-fd6a-48da-88f7-2dce23c1ccb4 admin admin] PATH_INFO: `/v3/projects/76d68afeb0874e2cbbcc8a989993f6a1/users/4d16aa4d3b124d6494e7d761ac9e5ca2/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:12:59.199079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4fcff-fd6a-48da-88f7-2dce23c1ccb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d68afeb0874e2cbbcc8a989993f6a1, user_id=4d16aa4d3b124d6494e7d761ac9e5ca2, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:12:59.201912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4fcff-fd6a-48da-88f7-2dce23c1ccb4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:12:59.213544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1183/2338] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:12:59 2022] PUT /identity/v3/projects/76d68afeb0874e2cbbcc8a989993f6a1/users/4d16aa4d3b124d6494e7d761ac9e5ca2/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:13:02.286065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caea4b-a5fd-43bd-abaf-ae3636951c29 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:02.286522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caea4b-a5fd-43bd-abaf-ae3636951c29 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:02.286719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caea4b-a5fd-43bd-abaf-ae3636951c29 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:02.288526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1156/2339] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:13:02.308934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82af1-4d46-484b-99b2-f0b02317b721 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:02.309468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82af1-4d46-484b-99b2-f0b02317b721 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:02.309578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82af1-4d46-484b-99b2-f0b02317b721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:02.346300 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0af82af1-4d46-484b-99b2-f0b02317b721 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:02.349439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0af82af1-4d46-484b-99b2-f0b02317b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:02.427084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:13:02.465157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1184/2340] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:13:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:13:02.481120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caea4b-a5fd-43bd-abaf-ae3636951c29 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:02.483081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-43caea4b-a5fd-43bd-abaf-ae3636951c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:02.598119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caea4b-a5fd-43bd-abaf-ae3636951c29 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:02.616271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003573-fdea-490f-a5ec-076a10cb090c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:02.616917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003573-fdea-490f-a5ec-076a10cb090c service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:02.617197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003573-fdea-490f-a5ec-076a10cb090c service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:02.617473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003573-fdea-490f-a5ec-076a10cb090c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:02.642010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003573-fdea-490f-a5ec-076a10cb090c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:02.644383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003573-fdea-490f-a5ec-076a10cb090c service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:02.687226 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1157/2341] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:13:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:13:02.803931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325801eb-7a86-4adc-b024-ecd3f1eef1dd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:02.804541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325801eb-7a86-4adc-b024-ecd3f1eef1dd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:02.805023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325801eb-7a86-4adc-b024-ecd3f1eef1dd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:02.807786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1185/2342] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:13:02.815107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4602ed-847c-42a7-9476-b423447a74b1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:02.815478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4602ed-847c-42a7-9476-b423447a74b1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:02.815693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4602ed-847c-42a7-9476-b423447a74b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:02.872853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8b4602ed-847c-42a7-9476-b423447a74b1 None None] MFA Rules not processed for user `465160a7e1c24601b83be37681ef322d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:02.876151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8b4602ed-847c-42a7-9476-b423447a74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:03.003362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:13:03.051437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1158/2343] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:13:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:13:03.136694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325801eb-7a86-4adc-b024-ecd3f1eef1dd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:03.154333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325801eb-7a86-4adc-b024-ecd3f1eef1dd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:03.160358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425759f-4be3-422d-bcd9-91f8764a24e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:03.160801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425759f-4be3-422d-bcd9-91f8764a24e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:03.161078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425759f-4be3-422d-bcd9-91f8764a24e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:03.161348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425759f-4be3-422d-bcd9-91f8764a24e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:03.185819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425759f-4be3-422d-bcd9-91f8764a24e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:03.194251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425759f-4be3-422d-bcd9-91f8764a24e5 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:03.218398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1186/2344] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:13:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:13:03.424150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e02f3-a919-4617-b5d9-aeddbfbbfe0c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:03.424695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e02f3-a919-4617-b5d9-aeddbfbbfe0c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:03.424695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e02f3-a919-4617-b5d9-aeddbfbbfe0c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:03.426334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1159/2345] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:13:03.440459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac0b3-fec9-4e31-a8d6-d87b88b25a94 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:03.441446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac0b3-fec9-4e31-a8d6-d87b88b25a94 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:03.441927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac0b3-fec9-4e31-a8d6-d87b88b25a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:03.480913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-91dac0b3-fec9-4e31-a8d6-d87b88b25a94 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:03.483206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-91dac0b3-fec9-4e31-a8d6-d87b88b25a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:03.512117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1187/2346] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:13:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:13:03.538050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e02f3-a919-4617-b5d9-aeddbfbbfe0c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:03.557035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e02f3-a919-4617-b5d9-aeddbfbbfe0c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:03.564354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:03.564974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:03.565248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:03.565525 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:03.592211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:03.593877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:03.620140 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1160/2347] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:13:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:13:05.663298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4da25-30f6-4dae-9e58-828078fdf0fb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:05.663915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4da25-30f6-4dae-9e58-828078fdf0fb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:05.663915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4da25-30f6-4dae-9e58-828078fdf0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:05.705935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-63a4da25-30f6-4dae-9e58-828078fdf0fb None None] MFA Rules not processed for user `4d16aa4d3b124d6494e7d761ac9e5ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:05.707505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-63a4da25-30f6-4dae-9e58-828078fdf0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:05.794993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1188/2348] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:13:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:13:05.810121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:05.812875 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:05.842179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb185-3ab7-4d02-8544-391921bda7f9 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:05.849953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:05.850692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:05.850886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:05.851482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:05.926267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:05.928212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:05.947889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1161/2349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:13:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:13:07.385583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848baf22-f075-4280-8315-6a6c6d8045c6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:07.386042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848baf22-f075-4280-8315-6a6c6d8045c6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:07.386239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848baf22-f075-4280-8315-6a6c6d8045c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:07.415285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-848baf22-f075-4280-8315-6a6c6d8045c6 None None] MFA Rules not processed for user `d4e3d425e2e54e4d879ab4399f914361`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:07.416725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-848baf22-f075-4280-8315-6a6c6d8045c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:07.432000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1189/2350] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:13:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:13:07.748776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:07.750729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:07.765379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39f6d-22e7-44ea-9b62-02aa1e10d584 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:07.770221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:07.771249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:07.772023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:07.772023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:07.774078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:07.856656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:07.859347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:07.873565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1162/2351] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:13:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:13:09.061981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bdf6-dbb1-4506-a5a2-33fd18efbeec None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:09.062483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bdf6-dbb1-4506-a5a2-33fd18efbeec None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:09.062591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bdf6-dbb1-4506-a5a2-33fd18efbeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:09.089217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-45d6bdf6-dbb1-4506-a5a2-33fd18efbeec None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:09.090476 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-45d6bdf6-dbb1-4506-a5a2-33fd18efbeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:09.221220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1190/2352] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:13:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:13:09.229506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:09.232338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:09.402451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d72f8-bc56-4e95-be1f-cc17e358933e service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:09.412675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:09.413583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:09.414022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:09.414452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:09.430009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:09.434417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:09.440707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:13:09.468049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1163/2353] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:13:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:13:19.180431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=82 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:13:19.452196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:13:38.510949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:38.511487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:38.511583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:38.530832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:38.532049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:38.539527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1191/2354] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 08:13:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:13:38.557287 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:38.570512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6ba60-57d7-45d3-be86-4710e5bf4ddd service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:38.577625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:38.578235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:38.578514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:38.578781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:38.588241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:38.590030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:38.601734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1164/2355] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:13:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:13:48.224307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:48.225687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:48.297091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384eac5-c977-478b-9f0b-1e7d534c0956 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:48.302036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78109d7-4212-4eee-be19-e03b4242ee4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:48.302641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78109d7-4212-4eee-be19-e03b4242ee4c service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:48.302914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78109d7-4212-4eee-be19-e03b4242ee4c service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:48.303186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78109d7-4212-4eee-be19-e03b4242ee4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:48.305949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a78109d7-4212-4eee-be19-e03b4242ee4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:48.317123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78109d7-4212-4eee-be19-e03b4242ee4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:48.318683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78109d7-4212-4eee-be19-e03b4242ee4c service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:48.328358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1192/2356] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:13:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:13:48.595100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:13:54.381610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:13:54.390684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac25e-3d03-4929-84f6-b380177b554d service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:13:54.394275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828783-fd59-452c-90dc-ac8e50e496e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:13:54.394861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828783-fd59-452c-90dc-ac8e50e496e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:54.395139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828783-fd59-452c-90dc-ac8e50e496e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:54.395421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828783-fd59-452c-90dc-ac8e50e496e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:54.404968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828783-fd59-452c-90dc-ac8e50e496e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:13:54.406394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828783-fd59-452c-90dc-ac8e50e496e5 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:13:54.416476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1165/2357] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:13:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:13:58.324335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=35 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:13:59.207188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb80565-f723-4057-a464-3026e5b370be None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:13:59.207513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb80565-f723-4057-a464-3026e5b370be None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:13:59.207792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb80565-f723-4057-a464-3026e5b370be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:13:59.227547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-edb80565-f723-4057-a464-3026e5b370be None None] MFA Rules not processed for user `46509a2b78c24e67b2186678a13228aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:13:59.228766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-edb80565-f723-4057-a464-3026e5b370be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:13:59.283371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1193/2358] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:13:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:14:04.411782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:14:09.276813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=25 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:14:48.294534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776598bf-642f-4165-beaf-d9fd90fd8fe5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:14:48.295104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776598bf-642f-4165-beaf-d9fd90fd8fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:14:48.295104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776598bf-642f-4165-beaf-d9fd90fd8fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:14:48.315668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-776598bf-642f-4165-beaf-d9fd90fd8fe5 None None] MFA Rules not processed for user `415b9de52afe4122b65ce6adeaab16b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:14:48.316903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-776598bf-642f-4165-beaf-d9fd90fd8fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:14:48.375186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1166/2359] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:14:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:14:54.530104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d3d5-de6a-4f99-a368-e80a4e7d0e30 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:14:54.530690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d3d5-de6a-4f99-a368-e80a4e7d0e30 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:14:54.530811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d3d5-de6a-4f99-a368-e80a4e7d0e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:14:54.554261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b340d3d5-de6a-4f99-a368-e80a4e7d0e30 None None] MFA Rules not processed for user `4cd431767adb4fbe8d17de4c56915d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:14:54.555673 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b340d3d5-de6a-4f99-a368-e80a4e7d0e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:14:54.615690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1194/2360] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:14:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:14:58.319723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9370-b074-4cb0-bb6e-4876bbb27a28 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:14:58.320225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9370-b074-4cb0-bb6e-4876bbb27a28 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:14:58.320355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9370-b074-4cb0-bb6e-4876bbb27a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:14:58.345255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6e5e9370-b074-4cb0-bb6e-4876bbb27a28 None None] MFA Rules not processed for user `b531d7ca59814d359b30264d2c9f7116`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:14:58.346666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6e5e9370-b074-4cb0-bb6e-4876bbb27a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:14:58.409145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1167/2361] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:14:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:15:01.328824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060d8d-afd0-4942-89d2-5c6cc47a28ab None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:01.329358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060d8d-afd0-4942-89d2-5c6cc47a28ab None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:01.329358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060d8d-afd0-4942-89d2-5c6cc47a28ab None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:01.331206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1195/2362] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:15:01.602035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:01.602594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:01.602926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:01.626729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] MFA Rules not processed for user `8ab28faeca0b4289b501d17ceb360378`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:15:01.628383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:01.639819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1168/2363] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:15:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:15:01.673556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060d8d-afd0-4942-89d2-5c6cc47a28ab None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:01.693183 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060d8d-afd0-4942-89d2-5c6cc47a28ab None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:01.698914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:01.700104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:01.700584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:01.701084 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:01.710251 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:01.712136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:01.724961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:01.726657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:01.739789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1196/2364] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:15:01.805729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65627-ceb7-48a3-8998-3e26aca339df None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:01.810955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:01.811611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:01.811889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:01.812157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] PATH_INFO: `/v3/users/46509a2b78c24e67b2186678a13228aa` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:01.813421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=46509a2b78c24e67b2186678a13228aa)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:01.815630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:01.865605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:01.867501 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46509a2b78c24e67b2186678a13228aa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:01.881902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46509a2b78c24e67b2186678a13228aa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:01.889636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46509a2b78c24e67b2186678a13228aa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:01.890372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46509a2b78c24e67b2186678a13228aa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:01.891015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46509a2b78c24e67b2186678a13228aa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:01.905353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1169/2365] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:15:01 2022] DELETE /identity/v3/users/46509a2b78c24e67b2186678a13228aa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:15:02.084878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:02.098053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207e33-85be-4bc4-a4b6-c63ecd0b6475 service placement] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:02.161337 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:02.162004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:02.162284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:02.162554 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] PATH_INFO: `/v3/projects/ff0c216a9fee4a5986051c797d877706` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:02.163728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0c216a9fee4a5986051c797d877706)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:02.165711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:02.214293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0c216a9fee4a5986051c797d877706', 'request_id': 'req-a010fcff-d2c8-4e34-926b-4e0438c07170'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:02.220462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0c216a9fee4a5986051c797d877706', 'request_id': 'req-a010fcff-d2c8-4e34-926b-4e0438c07170'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:02.226616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0c216a9fee4a5986051c797d877706', 'request_id': 'req-a010fcff-d2c8-4e34-926b-4e0438c07170'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:02.239618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] The token cache is being invalidate because project ff0c216a9fee4a5986051c797d877706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:15:02.240175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:02.240804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:02.242298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1197/2366] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:15:02 2022] DELETE /identity/v3/projects/ff0c216a9fee4a5986051c797d877706 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:15:11.902007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=13,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:12.236438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:31.415009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:31.416550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:31.473063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09b307-6117-4f04-bced-14f3a15a0eda admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:31.519802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:31.520393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:31.520665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:31.520929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:31.522641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:31.590522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:31.591998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:31.602570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1170/2367] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:15:32.779046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:32.780504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:32.793108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010fcff-d2c8-4e34-926b-4e0438c07170 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:32.796836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d6357-ab16-41d7-bef4-b4c381e3d6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:32.797436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d6357-ab16-41d7-bef4-b4c381e3d6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:32.797714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d6357-ab16-41d7-bef4-b4c381e3d6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:32.797986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d6357-ab16-41d7-bef4-b4c381e3d6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:32.799717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-653d6357-ab16-41d7-bef4-b4c381e3d6f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:32.813583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d6357-ab16-41d7-bef4-b4c381e3d6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:32.815258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d6357-ab16-41d7-bef4-b4c381e3d6f7 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:32.826612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1198/2368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:15:41.597923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=74 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:42.821198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=6 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:42.874363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:42.875776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:42.890225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649f22-e35d-4313-a850-e28b2590ef47 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:42.897844 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:42.898732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:42.899008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:42.899277 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:42.901089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:42.967565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:42.969235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:42.981614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1171/2369] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:15:44.036381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:44.036865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:44.036976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:44.055730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] MFA Rules not processed for user `b83b1a254074456897dcb9430e29d4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:15:44.056920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:44.111630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1199/2370] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:15:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:15:51.366703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:51.376353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05b629-4242-45f1-825e-7c3383926b66 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:51.380000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:51.380709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:51.381054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:51.381358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:51.383105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:51.447706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:51.449192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:51.459367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1172/2371] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:15:52.262849 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:52.264480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:52.280329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f145be-25c6-4bdf-bbe9-73038e52fe1e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:52.287485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:52.288105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:52.288382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:52.288654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:52.295439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:52.358164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:52.360070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:52.369879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1200/2372] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:15:55.236400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:55.237965 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:55.250311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77816e9-0b79-4779-b3ba-d052bed9c659 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:55.255000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:55.255727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:55.256067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:55.256342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] PATH_INFO: `/v3/users/415b9de52afe4122b65ce6adeaab16b9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:55.257475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415b9de52afe4122b65ce6adeaab16b9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:55.259437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:55.311633 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415b9de52afe4122b65ce6adeaab16b9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.324028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415b9de52afe4122b65ce6adeaab16b9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.330950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415b9de52afe4122b65ce6adeaab16b9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.331646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415b9de52afe4122b65ce6adeaab16b9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.332270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d8479597-2e9d-4174-bcd0-381a30423ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415b9de52afe4122b65ce6adeaab16b9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.345935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1173/2373] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:15:55 2022] DELETE /identity/v3/users/415b9de52afe4122b65ce6adeaab16b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:15:55.516531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:55.540681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f328-95e8-4538-9ff2-7d15d80652c4 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:55.605436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:55.606483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:55.606765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:55.607059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] PATH_INFO: `/v3/projects/884ef55f39ac4aabb5a21dad94e7058a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:55.608243 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884ef55f39ac4aabb5a21dad94e7058a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:55.610143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:55.656926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:55.660330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884ef55f39ac4aabb5a21dad94e7058a', 'request_id': 'req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.668505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884ef55f39ac4aabb5a21dad94e7058a', 'request_id': 'req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.674525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884ef55f39ac4aabb5a21dad94e7058a', 'request_id': 'req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.687823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] The token cache is being invalidate because project 884ef55f39ac4aabb5a21dad94e7058a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:15:55.688108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.688976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d0063c8b-c2b1-4c0f-8726-4c068b1a9bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:15:55.690481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1201/2374] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:15:55 2022] DELETE /identity/v3/projects/884ef55f39ac4aabb5a21dad94e7058a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:15:55.695586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dbbb5-42a4-4546-bc67-6022cbbd1530 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:55.695904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dbbb5-42a4-4546-bc67-6022cbbd1530 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:55.696181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dbbb5-42a4-4546-bc67-6022cbbd1530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:55.704721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:55.717093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7f7dbbb5-42a4-4546-bc67-6022cbbd1530 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:15:55.718327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7f7dbbb5-42a4-4546-bc67-6022cbbd1530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:55.777928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1174/2375] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:15:55.785482 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ffc8-ce45-4962-ac43-459b09d0891e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:55.785790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ffc8-ce45-4962-ac43-459b09d0891e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:55.786062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ffc8-ce45-4962-ac43-459b09d0891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:55.805820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dc98ffc8-ce45-4962-ac43-459b09d0891e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:15:55.807014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dc98ffc8-ce45-4962-ac43-459b09d0891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:55.816437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1202/2376] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:15:55.820555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dbbb5-42a4-4546-bc67-6022cbbd1530 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:55.830085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dbbb5-42a4-4546-bc67-6022cbbd1530 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:55.834497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:55.835106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:55.835379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:55.835690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:55.836326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:15:55.836620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:55.838201 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:55.850418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1175/2377] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:15:55.854501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ffc8-ce45-4962-ac43-459b09d0891e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:55.864230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ffc8-ce45-4962-ac43-459b09d0891e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:55.868793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:55.869374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:55.869648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:55.869914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:55.870713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:55.872785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:55.899754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1203/2378] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:15:55 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:15:55.904654 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:55.914594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8920a-9766-413d-90f3-7e0ba4e751de admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:55.971785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:55.972467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:55.972745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:55.973013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:55.973640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:55.975574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:56.000272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1176/2379] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:15:55 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:15:56.004646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:56.016276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef6b6c-839f-4942-b9a3-5a34fe4dab10 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:56.021236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:56.021851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:56.022131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:56.022399 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:56.023039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:56.024691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:56.039075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1204/2380] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:15:56.040597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:56.051751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba411d-7fb0-49cb-8deb-d45b1d45a8ca admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:56.056407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e48c8-6ca3-42d3-8a51-b06af9f98bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:56.057003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e48c8-6ca3-42d3-8a51-b06af9f98bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:56.057282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e48c8-6ca3-42d3-8a51-b06af9f98bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:56.057626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e48c8-6ca3-42d3-8a51-b06af9f98bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:56.058644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e48c8-6ca3-42d3-8a51-b06af9f98bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:56.060328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e48c8-6ca3-42d3-8a51-b06af9f98bd6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:56.071719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1177/2381] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:15:56.076589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:56.086773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77a9c-6cd2-4e22-8b6e-c21e1614de8c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:56.092154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:56.092806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:56.093079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:56.093346 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] PATH_INFO: `/v3/projects/850e62ec7f6345469e83ac4aac857816/users/d295daeedd334a50980a57b99f0d794b/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:56.233499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] RBAC: Authorizing `identity:create_grant(project_id=850e62ec7f6345469e83ac4aac857816, user_id=d295daeedd334a50980a57b99f0d794b, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:56.236155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:56.249381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1205/2382] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:15:56 2022] PUT /identity/v3/projects/850e62ec7f6345469e83ac4aac857816/users/d295daeedd334a50980a57b99f0d794b/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:15:56.254622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:56.255112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:56.255230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:56.274379 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:15:56.275608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:56.337980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1178/2383] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:15:56.348473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:56.350143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:56.406161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba33578-cd71-45c8-9224-e88b1795379c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:56.409693 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230efe39-7e0e-4d89-9274-df34ba147ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:56.410281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230efe39-7e0e-4d89-9274-df34ba147ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:56.410555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230efe39-7e0e-4d89-9274-df34ba147ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:56.410822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230efe39-7e0e-4d89-9274-df34ba147ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:56.419604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230efe39-7e0e-4d89-9274-df34ba147ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:56.420996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230efe39-7e0e-4d89-9274-df34ba147ac4 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:56.430057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1206/2384] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:15:57.270653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:15:57.272118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:57.308820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:15:57.405871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9ad99-35c0-424b-830c-6143050c943c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:15:57.412475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:15:57.413102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:15:57.413785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:15:57.413785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:15:57.415488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:15:57.495374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:15:57.498168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:15:57.519130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1179/2385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:00.892669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff3cbe-f32b-470b-bae3-2545ea929c75 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:00.893171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff3cbe-f32b-470b-bae3-2545ea929c75 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:00.893171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff3cbe-f32b-470b-bae3-2545ea929c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:00.922611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-37ff3cbe-f32b-470b-bae3-2545ea929c75 None None] MFA Rules not processed for user `d295daeedd334a50980a57b99f0d794b`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:00.923859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-37ff3cbe-f32b-470b-bae3-2545ea929c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:01.006535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1207/2386] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:16:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:01.013735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:01.025347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b5d1a-0e98-4c47-9c5e-3d5bce06e04b service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:01.032616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be279d19-8259-4d6f-919c-3b94c2ae40c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:01.033608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be279d19-8259-4d6f-919c-3b94c2ae40c5 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:01.034140 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be279d19-8259-4d6f-919c-3b94c2ae40c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:01.035181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be279d19-8259-4d6f-919c-3b94c2ae40c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:01.047795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be279d19-8259-4d6f-919c-3b94c2ae40c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:01.050315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be279d19-8259-4d6f-919c-3b94c2ae40c5 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:01.066386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1180/2387] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:02.548795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff3cbe-f32b-470b-bae3-2545ea929c75 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:02.551090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:02.551540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:02.551675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:02.556465 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:16:02.563141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff3cbe-f32b-470b-bae3-2545ea929c75 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:02.569810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:02.570917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:02.571480 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:02.571772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:02.574604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:02.575357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] MFA Rules not processed for user `d295daeedd334a50980a57b99f0d794b`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:02.576909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:02.584977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1181/2388] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:02.585151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:02.586481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:02.596088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1208/2389] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:03.290755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:03.293643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:03.389394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147c55b-6267-46f0-ae25-eb45fa133e97 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:03.394935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:03.395688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:03.396037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:03.396385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:03.398248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:03.412482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:03.414413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:03.425982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1182/2390] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:07.527303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:07.550511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84675-121d-4cd0-b978-4d126be85cc7 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:07.570481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaee28-529a-4a32-822f-3c0b1d0daeb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:07.571429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaee28-529a-4a32-822f-3c0b1d0daeb6 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:07.572088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaee28-529a-4a32-822f-3c0b1d0daeb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:07.572565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaee28-529a-4a32-822f-3c0b1d0daeb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:07.575235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1dbaee28-529a-4a32-822f-3c0b1d0daeb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:07.599937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaee28-529a-4a32-822f-3c0b1d0daeb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:07.602957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaee28-529a-4a32-822f-3c0b1d0daeb6 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:07.645577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1209/2391] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:12.492976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:12.494472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:12.510406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfdbb3-f9fa-469a-abdc-ca85b7f0e763 service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:12.516970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:12.517597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:12.517882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:12.518151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:12.520068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:12.533611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:12.535227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:12.567711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1183/2392] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:13.512122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de04b2-6dfb-4fb1-a670-463ec42bee3e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:13.512637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de04b2-6dfb-4fb1-a670-463ec42bee3e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:13.512637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de04b2-6dfb-4fb1-a670-463ec42bee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:13.533915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-53de04b2-6dfb-4fb1-a670-463ec42bee3e None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:13.535141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-53de04b2-6dfb-4fb1-a670-463ec42bee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:13.597958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1210/2393] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:13.657435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:13.659052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:13.665579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:16:13.755345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d8b2a-7abf-425a-bd92-30033faae49c service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:13.762538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea68cb-0c75-485f-acf1-ffc37c034676 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:13.763532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea68cb-0c75-485f-acf1-ffc37c034676 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:13.764037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea68cb-0c75-485f-acf1-ffc37c034676 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:13.764306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea68cb-0c75-485f-acf1-ffc37c034676 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:13.779976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea68cb-0c75-485f-acf1-ffc37c034676 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:13.781910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea68cb-0c75-485f-acf1-ffc37c034676 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:13.793065 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1184/2394] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:16:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:16:14.589114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de04b2-6dfb-4fb1-a670-463ec42bee3e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:14.613101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de04b2-6dfb-4fb1-a670-463ec42bee3e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:14.621122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:14.622600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:14.622888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:14.623162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:14.632218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:14.647154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:14.650609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:14.697262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1211/2395] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:17.054062 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5249-c6f7-4f7a-93a2-693334474137 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:17.054527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5249-c6f7-4f7a-93a2-693334474137 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:17.054610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5249-c6f7-4f7a-93a2-693334474137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:17.103731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d0ac5249-c6f7-4f7a-93a2-693334474137 None None] MFA Rules not processed for user `b531d7ca59814d359b30264d2c9f7116`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:17.105944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d0ac5249-c6f7-4f7a-93a2-693334474137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:17.120341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1185/2396] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:16:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:17.600618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:17.611007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d26642-0319-482d-9acf-fdfb7c95efe9 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:17.615635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cef133-4ef0-4193-a14a-d843e8410bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:17.616515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef133-4ef0-4193-a14a-d843e8410bac service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:17.616951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef133-4ef0-4193-a14a-d843e8410bac service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:17.617217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef133-4ef0-4193-a14a-d843e8410bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:17.618951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-97cef133-4ef0-4193-a14a-d843e8410bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:17.629966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef133-4ef0-4193-a14a-d843e8410bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:17.632831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef133-4ef0-4193-a14a-d843e8410bac service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:17.642923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1212/2397] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:27.086259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=33 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:16:27.638178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=48 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:16:31.363699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317eeb-c3c6-40ee-9544-d7518fc3983a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.364253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317eeb-c3c6-40ee-9544-d7518fc3983a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.364253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317eeb-c3c6-40ee-9544-d7518fc3983a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.366360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1186/2398] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:16:31.372286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1303eb7-f25a-4919-8936-2d4ba8a380a5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.372910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1303eb7-f25a-4919-8936-2d4ba8a380a5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.372910 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1303eb7-f25a-4919-8936-2d4ba8a380a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.396052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c1303eb7-f25a-4919-8936-2d4ba8a380a5 None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:31.397677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c1303eb7-f25a-4919-8936-2d4ba8a380a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:31.410453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1213/2399] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:31.425899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b317eeb-c3c6-40ee-9544-d7518fc3983a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:31.427753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4b317eeb-c3c6-40ee-9544-d7518fc3983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:31.502553 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b317eeb-c3c6-40ee-9544-d7518fc3983a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:31.511045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e04145-2227-486e-8cec-357ac1a6ef61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:31.511919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04145-2227-486e-8cec-357ac1a6ef61 service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.512385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04145-2227-486e-8cec-357ac1a6ef61 service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.512820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04145-2227-486e-8cec-357ac1a6ef61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.527959 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e04145-2227-486e-8cec-357ac1a6ef61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:31.529381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e04145-2227-486e-8cec-357ac1a6ef61 service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:31.542017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1187/2400] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:31.621690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90d1f3-c678-4dfc-adb2-e5a9429eb9f2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.622000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90d1f3-c678-4dfc-adb2-e5a9429eb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.622556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90d1f3-c678-4dfc-adb2-e5a9429eb9f2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.625186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1214/2401] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:16:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:16:31.630307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaab9b3-32f5-4d85-bca1-c16a5c415560 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.630597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaab9b3-32f5-4d85-bca1-c16a5c415560 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.631134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaab9b3-32f5-4d85-bca1-c16a5c415560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.651804 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-acaab9b3-32f5-4d85-bca1-c16a5c415560 None None] MFA Rules not processed for user `465160a7e1c24601b83be37681ef322d`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:31.653136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-acaab9b3-32f5-4d85-bca1-c16a5c415560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:31.659868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1188/2402] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:31.672311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90d1f3-c678-4dfc-adb2-e5a9429eb9f2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:31.674019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0b90d1f3-c678-4dfc-adb2-e5a9429eb9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:31.687023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90d1f3-c678-4dfc-adb2-e5a9429eb9f2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:31.691627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ae176-ed0b-4d09-a2e4-2aecc0ae44a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:31.692216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae176-ed0b-4d09-a2e4-2aecc0ae44a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.692487 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae176-ed0b-4d09-a2e4-2aecc0ae44a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.692753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae176-ed0b-4d09-a2e4-2aecc0ae44a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.700703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae176-ed0b-4d09-a2e4-2aecc0ae44a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:31.702107 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae176-ed0b-4d09-a2e4-2aecc0ae44a4 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:31.710202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1215/2403] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:31.796952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b623da-d11e-41b4-b762-1222bcf39907 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.797238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b623da-d11e-41b4-b762-1222bcf39907 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.798024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b623da-d11e-41b4-b762-1222bcf39907 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.798862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1189/2404] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 08:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:16:31.804252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29374e1-7844-4d7c-82e3-0f28e043496f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.804535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29374e1-7844-4d7c-82e3-0f28e043496f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.805016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29374e1-7844-4d7c-82e3-0f28e043496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.827447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b29374e1-7844-4d7c-82e3-0f28e043496f None None] MFA Rules not processed for user `b4e95079af6b4768bc38709a8bdc27bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:31.828652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b29374e1-7844-4d7c-82e3-0f28e043496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:31.838804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1216/2405] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:31.849988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b623da-d11e-41b4-b762-1222bcf39907 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:31.861403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b623da-d11e-41b4-b762-1222bcf39907 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:31.864916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:31.865500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:31.865771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:31.866037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:31.876012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:31.877448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:31.887750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1190/2406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:16:34.009483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8d6a-8e08-47c0-90a2-bfb9acc7cdf4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:34.010553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8d6a-8e08-47c0-90a2-bfb9acc7cdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:34.010776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8d6a-8e08-47c0-90a2-bfb9acc7cdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:34.029102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9e3d8d6a-8e08-47c0-90a2-bfb9acc7cdf4 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:34.030301 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9e3d8d6a-8e08-47c0-90a2-bfb9acc7cdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:34.037725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1217/2407] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:34.050651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:34.076776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d696c1-2f8d-4c1a-911f-3ab075aec74c service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:34.082371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:34.082991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:34.083336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:34.084695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:34.095880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:34.097459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:34.106852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1191/2408] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:16:44.024306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=15 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:16:44.103028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=41 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:16:52.049779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423328-637b-4cc0-b2fa-ca9b10e86dd1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:52.050605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423328-637b-4cc0-b2fa-ca9b10e86dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:52.051033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423328-637b-4cc0-b2fa-ca9b10e86dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:52.072370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-be423328-637b-4cc0-b2fa-ca9b10e86dd1 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:16:52.073723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-be423328-637b-4cc0-b2fa-ca9b10e86dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:16:52.081052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1218/2409] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:16:52.093674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:16:52.104534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98a643-3e6a-4862-869e-67a911f80b83 service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:16:52.109728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:16:52.110355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:16:52.110632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:16:52.110905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:16:52.119928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:16:52.121526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:16:52.129747 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1192/2410] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:16:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:17:02.066843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:02.126350 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:39.852438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be423328-637b-4cc0-b2fa-ca9b10e86dd1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:39.861490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be423328-637b-4cc0-b2fa-ca9b10e86dd1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:39.864987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:39.865571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:39.865842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:39.866104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:39.867832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:39.879817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:39.881209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:39.891680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1219/2411] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:39.994824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:40.004530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef60f2-ccef-4440-b939-6a2d61a7d6d4 service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:40.008506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:40.009681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:40.010601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:40.010884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:40.012668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:40.025126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:40.026558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:40.036188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1193/2412] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:44.055282 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:44.057494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:44.139813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea6706-5ddf-4e9a-9485-66eaee93d2f2 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:44.145114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:44.146262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:44.146903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:44.147488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:44.150030 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:44.237330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:44.239464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:44.261384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1220/2413] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:45.074926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.078980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.097579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456970-b572-47c5-aa8d-caef5632af18 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.104629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.105538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.106027 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.106508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] PATH_INFO: `/v3/users/4cd431767adb4fbe8d17de4c56915d9a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.108061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd431767adb4fbe8d17de4c56915d9a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.110477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.194681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd431767adb4fbe8d17de4c56915d9a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.214015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd431767adb4fbe8d17de4c56915d9a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.222100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd431767adb4fbe8d17de4c56915d9a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.222857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd431767adb4fbe8d17de4c56915d9a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.223510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd431767adb4fbe8d17de4c56915d9a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.240898 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1194/2414] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:17:45 2022] DELETE /identity/v3/users/4cd431767adb4fbe8d17de4c56915d9a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:45.253216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.254657 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.279163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a946a51-bb78-4880-a163-67bbb04a5fff service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.352785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.353491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.353900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.354182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] PATH_INFO: `/v3/users/b531d7ca59814d359b30264d2c9f7116` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.355541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b531d7ca59814d359b30264d2c9f7116)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.357440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.406386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:45.409273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b531d7ca59814d359b30264d2c9f7116'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.410299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b531d7ca59814d359b30264d2c9f7116'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.424948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b531d7ca59814d359b30264d2c9f7116'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.425641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b531d7ca59814d359b30264d2c9f7116'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.433937 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e404fcf-9848-4a1b-a415-47fdbd600c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b531d7ca59814d359b30264d2c9f7116'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.438175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.441085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.449295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1221/2415] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:17:45 2022] DELETE /identity/v3/users/b531d7ca59814d359b30264d2c9f7116 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:45.459247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4506-df15-47fa-ad88-75ac5536c516 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.526200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.526835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.527118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.527388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] PATH_INFO: `/v3/projects/6e7fb2c8c8794ae19d1e9be460ea91bd` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.528567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7fb2c8c8794ae19d1e9be460ea91bd)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.530518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.587883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7fb2c8c8794ae19d1e9be460ea91bd', 'request_id': 'req-6b936105-a93d-45f4-ac05-8522b732f8a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.595622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7fb2c8c8794ae19d1e9be460ea91bd', 'request_id': 'req-6b936105-a93d-45f4-ac05-8522b732f8a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.600002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:45.603111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7fb2c8c8794ae19d1e9be460ea91bd', 'request_id': 'req-6b936105-a93d-45f4-ac05-8522b732f8a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.616842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] The token cache is being invalidate because project 6e7fb2c8c8794ae19d1e9be460ea91bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:17:45.617133 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.617814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.619619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1195/2416] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:17:45 2022] DELETE /identity/v3/projects/6e7fb2c8c8794ae19d1e9be460ea91bd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:17:45.624596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067c1c-bd92-435a-953b-1118de37a70f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.624883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067c1c-bd92-435a-953b-1118de37a70f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.625160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067c1c-bd92-435a-953b-1118de37a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.638746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.640220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.648450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4e067c1c-bd92-435a-953b-1118de37a70f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:45.650283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4e067c1c-bd92-435a-953b-1118de37a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.715058 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b936105-a93d-45f4-ac05-8522b732f8a9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.719667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.719828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1222/2417] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:45.720442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.720729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.721002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] PATH_INFO: `/v3/projects/e42dd73dfb5e45579ebb4bfe689dacea` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.722131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42dd73dfb5e45579ebb4bfe689dacea)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.724199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.728148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6709b-97df-4cbf-a42f-47634deba33d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.728439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6709b-97df-4cbf-a42f-47634deba33d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.728715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6709b-97df-4cbf-a42f-47634deba33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.747803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fff6709b-97df-4cbf-a42f-47634deba33d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:45.749000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fff6709b-97df-4cbf-a42f-47634deba33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.757462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1223/2418] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:17:45.762267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6709b-97df-4cbf-a42f-47634deba33d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.771131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6709b-97df-4cbf-a42f-47634deba33d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.773917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42dd73dfb5e45579ebb4bfe689dacea', 'request_id': 'req-977ad5a0-8311-4319-b438-dbb541b864e8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.782526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42dd73dfb5e45579ebb4bfe689dacea', 'request_id': 'req-977ad5a0-8311-4319-b438-dbb541b864e8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.788228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42dd73dfb5e45579ebb4bfe689dacea', 'request_id': 'req-977ad5a0-8311-4319-b438-dbb541b864e8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.799630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] The token cache is being invalidate because project e42dd73dfb5e45579ebb4bfe689dacea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:17:45.799924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.800580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-977ad5a0-8311-4319-b438-dbb541b864e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:45.802087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1196/2419] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:17:45 2022] DELETE /identity/v3/projects/e42dd73dfb5e45579ebb4bfe689dacea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:45.807681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011731b-53aa-46c2-9735-0e7f30552154 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.807967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011731b-53aa-46c2-9735-0e7f30552154 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.808244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011731b-53aa-46c2-9735-0e7f30552154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.828073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a011731b-53aa-46c2-9735-0e7f30552154 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:45.829280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a011731b-53aa-46c2-9735-0e7f30552154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.830152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.830760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.831035 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.831307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.831983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:17:45.832288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.833866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.844524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1197/2420] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:17:45.845939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc7ea-dd6a-44ac-9d7b-1efad8ae7b8c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.846453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc7ea-dd6a-44ac-9d7b-1efad8ae7b8c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.846575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1224/2421] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:17:45.846691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc7ea-dd6a-44ac-9d7b-1efad8ae7b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.855742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.857425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.865953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-eeccc7ea-dd6a-44ac-9d7b-1efad8ae7b8c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:45.867112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-eeccc7ea-dd6a-44ac-9d7b-1efad8ae7b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:45.870150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2917e8-1177-433b-bd7d-9a3e90b34136 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.874958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.875578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.875902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1198/2422] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:17:45.879066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.879384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.880013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc7ea-dd6a-44ac-9d7b-1efad8ae7b8c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.880130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.881924 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.892920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc7ea-dd6a-44ac-9d7b-1efad8ae7b8c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.897756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.898401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.898680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.898948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.899692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:17:45.900047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.901846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.914519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1199/2423] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:17:45.918821 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.923655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1225/2424] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:17:45 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:17:45.924778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:45.928837 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a141a-17cd-46d3-8700-1c57fb8062cc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.956546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:45.979214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:45.989673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:45.990635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:45.991177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:45.991541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:45.992168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:45.994690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732cb1-1b3f-40e1-912e-4fb462461a62 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:45.994843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:45.999379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.000024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.000315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.000583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.001197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.003111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.027886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1200/2425] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:17:45 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:17:46.028118 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1226/2426] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:17:45 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:17:46.029890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.030086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.041066 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc16d-2621-4004-8fd2-e58b9106cfd5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.098329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf529b-2a60-4e72-bec2-cde97d4dfb92 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.103094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.103742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.104016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.104288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.104917 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.105900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.106507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.106782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.106892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.107176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.107847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.109410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.123756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1227/2427] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:17:46.125145 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.136251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1201/2428] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:17:46 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:17:46.136438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a2896-03fe-4785-9783-a170b2233a84 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.137386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.140799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.141412 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.141668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.141935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.142566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.144168 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.147561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79722f-dede-417a-9a2d-143d48466876 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.153345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.153928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.154199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.154463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.155117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.158695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1228/2429] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:46.158822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.159345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.171649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1202/2430] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:17:46.171832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35913d95-8909-422d-b4d6-2b1c7e0a5991 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.172667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.175565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fda4bf-caa5-417d-b7fc-9fb8bf4f0ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.176213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda4bf-caa5-417d-b7fc-9fb8bf4f0ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.176483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda4bf-caa5-417d-b7fc-9fb8bf4f0ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.176753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda4bf-caa5-417d-b7fc-9fb8bf4f0ef2 admin admin] PATH_INFO: `/v3/projects/2ffd8f72f0754d8c987ae50ee5d79d86/users/0e4881220ae44d07b43a346b64570694/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.186099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b23a-9121-4a78-a027-76c75ba8edc9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.192522 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.193311 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.193618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.193998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.194657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.195696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fda4bf-caa5-417d-b7fc-9fb8bf4f0ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffd8f72f0754d8c987ae50ee5d79d86, user_id=0e4881220ae44d07b43a346b64570694, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.196937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.200514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fda4bf-caa5-417d-b7fc-9fb8bf4f0ef2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.208051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1203/2431] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:17:46.213423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.216454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1229/2432] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:46 2022] PUT /identity/v3/projects/2ffd8f72f0754d8c987ae50ee5d79d86/users/0e4881220ae44d07b43a346b64570694/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:17:46.221021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.221299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.221563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.223378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9faa-9bfe-40b8-9446-8dd254183966 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.241283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:46.242400 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:46.280518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55273c9c-289a-4c4c-86ad-5dc5aecf83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.281205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55273c9c-289a-4c4c-86ad-5dc5aecf83ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.281479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55273c9c-289a-4c4c-86ad-5dc5aecf83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.281751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55273c9c-289a-4c4c-86ad-5dc5aecf83ab admin admin] PATH_INFO: `/v3/projects/3a14d04f60c6465f973aba037d2dc0c5/users/2ca064552425428ebad9df458324275f/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.298094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55273c9c-289a-4c4c-86ad-5dc5aecf83ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a14d04f60c6465f973aba037d2dc0c5, user_id=2ca064552425428ebad9df458324275f, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.300901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55273c9c-289a-4c4c-86ad-5dc5aecf83ab admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.310769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1230/2433] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:17:46.315342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1204/2434] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:46 2022] PUT /identity/v3/projects/3a14d04f60c6465f973aba037d2dc0c5/users/2ca064552425428ebad9df458324275f/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:17:46.321496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.323461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:46.325924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4b36-e150-4256-ac69-8a55c59280be None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.326203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4b36-e150-4256-ac69-8a55c59280be None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.326470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4b36-e150-4256-ac69-8a55c59280be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.343104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:46.355403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ea6c4b36-e150-4256-ac69-8a55c59280be None None] MFA Rules not processed for user `2ca064552425428ebad9df458324275f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:46.356668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ea6c4b36-e150-4256-ac69-8a55c59280be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:46.373751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:46.382786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4ddbf-b298-4858-a076-5ca3e037a5c0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.421927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1205/2435] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:46.426248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c4b36-e150-4256-ac69-8a55c59280be None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.435858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.436602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.436917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.437217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.490750 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c4b36-e150-4256-ac69-8a55c59280be None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.496594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.497203 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.497478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.497743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.498364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.500295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.504385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.505957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.515701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1231/2436] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:46.529761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1206/2437] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:17:46 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:17:46.533776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.547170 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1a21-8f08-427d-aedc-0b8e669edc78 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.617110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.617727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.618003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.618921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.619809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.621832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.643357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1232/2438] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:17:46 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:17:46.647469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.658832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3c627-0610-4355-ae7b-436bdaa3c6e2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.663843 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.664456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.664730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.665003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.665863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.667509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.678890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1207/2439] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:46.683820 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.695750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130956-da6b-4db5-947c-d7ec4210cd04 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.701527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.702078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.702358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.702731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] PATH_INFO: `/v3/projects/b29d504a08674888bbe05859ab04b591/users/93877ce0cdd748e9930ed4e9b76c130f/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.715690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:46.721423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29d504a08674888bbe05859ab04b591, user_id=93877ce0cdd748e9930ed4e9b76c130f, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.724472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.738298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1233/2440] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:46 2022] PUT /identity/v3/projects/b29d504a08674888bbe05859ab04b591/users/93877ce0cdd748e9930ed4e9b76c130f/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:46.742892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.754007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc20d9-fb88-40ec-9cb7-2cf5f0c36299 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.815457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffa6ef-efe2-4e10-b881-d2061ca8049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.816066 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffa6ef-efe2-4e10-b881-d2061ca8049f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.816349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffa6ef-efe2-4e10-b881-d2061ca8049f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.816624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffa6ef-efe2-4e10-b881-d2061ca8049f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.817429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffa6ef-efe2-4e10-b881-d2061ca8049f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.819563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffa6ef-efe2-4e10-b881-d2061ca8049f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.836511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1208/2441] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:17:46.841712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:46.853378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13732b-61be-4097-87df-0451fa282ebb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:46.860684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:46.861362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.861669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.862027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] PATH_INFO: `/v3/projects/b29d504a08674888bbe05859ab04b591/users/93877ce0cdd748e9930ed4e9b76c130f/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.864582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29d504a08674888bbe05859ab04b591, user_id=93877ce0cdd748e9930ed4e9b76c130f, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:46.867069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:46.880271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1234/2442] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:46 2022] PUT /identity/v3/projects/b29d504a08674888bbe05859ab04b591/users/93877ce0cdd748e9930ed4e9b76c130f/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:17:46.892419 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55632b1-3886-4dc7-b900-d2a687b445ef None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:46.892712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55632b1-3886-4dc7-b900-d2a687b445ef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:46.892991 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55632b1-3886-4dc7-b900-d2a687b445ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:46.925047 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b55632b1-3886-4dc7-b900-d2a687b445ef None None] MFA Rules not processed for user `93877ce0cdd748e9930ed4e9b76c130f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:46.926306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b55632b1-3886-4dc7-b900-d2a687b445ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:46.944137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:46.999893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1209/2443] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:47.011677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:47.013525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:47.080717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1caa90-2dc3-43b5-8c46-8290202f5d23 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:47.084889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:47.085500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.085774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.086043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.148610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:47.150358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:47.160656 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1235/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:47.195280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dca72-83b4-498e-926a-b45a1549d829 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.195858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dca72-83b4-498e-926a-b45a1549d829 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.195858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dca72-83b4-498e-926a-b45a1549d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.226582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-724dca72-83b4-498e-926a-b45a1549d829 None None] MFA Rules not processed for user `0e4881220ae44d07b43a346b64570694`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:47.229010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-724dca72-83b4-498e-926a-b45a1549d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:47.317932 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1210/2445] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:47.323093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:47.410989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168840-b79b-4454-b89c-7a77abcea4f2 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:47.416838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:47.417442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.417707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.417973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.418594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:47.420506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:47.452838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1236/2446] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:17:47 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:17:47.459686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dca72-83b4-498e-926a-b45a1549d829 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:47.470894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dca72-83b4-498e-926a-b45a1549d829 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:47.553070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:47.553680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.553955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.554222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.554842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:47.557072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:47.578669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1211/2447] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:17:47 2022] POST /identity/v3/users => generated 308 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:17:47.584580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:47.596882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a70b9b-6eb0-4d97-be01-8156821120d6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:47.603772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:47.604431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.604706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.604975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.605628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:47.607205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:47.620272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1237/2448] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:47.624423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:47.635755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521382a-399d-4283-a7de-40f7c13c47e4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:47.642212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:47.642909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.643179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.643481 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] PATH_INFO: `/v3/projects/84811d8171d4438aa9e6381626f986ed/users/e64d99b595e24d28a968e5b6c50c79ba/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.661231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84811d8171d4438aa9e6381626f986ed, user_id=e64d99b595e24d28a968e5b6c50c79ba, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:47.663955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:47.681568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1212/2449] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:47 2022] PUT /identity/v3/projects/84811d8171d4438aa9e6381626f986ed/users/e64d99b595e24d28a968e5b6c50c79ba/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:47.685555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:47.693452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:47.699767 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979ef1-3904-4811-b9e3-60c519b9db36 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:47.763843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edb75e-c0ea-4048-b468-8e4c2fda5eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:47.764528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edb75e-c0ea-4048-b468-8e4c2fda5eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.764816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edb75e-c0ea-4048-b468-8e4c2fda5eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.765071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edb75e-c0ea-4048-b468-8e4c2fda5eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.765712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edb75e-c0ea-4048-b468-8e4c2fda5eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:47.767283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edb75e-c0ea-4048-b468-8e4c2fda5eb0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:47.778350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1238/2450] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:47.782291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:47.793192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949057-140b-47fc-8a49-13bc2e300ea0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:47.798015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:47.798657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:47.799014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:47.799291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] PATH_INFO: `/v3/projects/84811d8171d4438aa9e6381626f986ed/users/e64d99b595e24d28a968e5b6c50c79ba/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:47.801178 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84811d8171d4438aa9e6381626f986ed, user_id=e64d99b595e24d28a968e5b6c50c79ba, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:47.803880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:47.806867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:47.815810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1213/2451] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:47 2022] PUT /identity/v3/projects/84811d8171d4438aa9e6381626f986ed/users/e64d99b595e24d28a968e5b6c50c79ba/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:48.477304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b809-705f-4ebd-84d1-3f022bd58a84 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:48.478452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b809-705f-4ebd-84d1-3f022bd58a84 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:48.478452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b809-705f-4ebd-84d1-3f022bd58a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:48.506117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d795b809-705f-4ebd-84d1-3f022bd58a84 None None] MFA Rules not processed for user `e64d99b595e24d28a968e5b6c50c79ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:48.507333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d795b809-705f-4ebd-84d1-3f022bd58a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:48.595917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1239/2452] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:48 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:49.077227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:49.079103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:49.162205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a34db-c4cc-4107-af9c-252770ed4759 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:49.168454 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:49.169073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:49.169354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:49.169625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:49.171368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:49.184651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:49.186304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:49.197409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1214/2453] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:49.670895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795b809-705f-4ebd-84d1-3f022bd58a84 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:49.733626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795b809-705f-4ebd-84d1-3f022bd58a84 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:49.738133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:49.738751 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:49.739025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:49.739288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] PATH_INFO: `/v3/users/0e4881220ae44d07b43a346b64570694` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:49.740417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4881220ae44d07b43a346b64570694)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:49.742306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:49.770674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:49.788194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4881220ae44d07b43a346b64570694'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:49.788873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4881220ae44d07b43a346b64570694'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:49.801150 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4881220ae44d07b43a346b64570694'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:49.801818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4881220ae44d07b43a346b64570694'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:49.809637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4881220ae44d07b43a346b64570694'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:49.824303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1240/2454] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:17:49 2022] DELETE /identity/v3/users/0e4881220ae44d07b43a346b64570694 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:49.995388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.005740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c2bc-42dc-4646-be3a-abe8fac4624e service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.062432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.063055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.063334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.063887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] PATH_INFO: `/v3/projects/2ffd8f72f0754d8c987ae50ee5d79d86` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.064996 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffd8f72f0754d8c987ae50ee5d79d86)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.066913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.115165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffd8f72f0754d8c987ae50ee5d79d86', 'request_id': 'req-9bb9d94f-dc9c-47f8-9367-7567978e42fd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.122981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffd8f72f0754d8c987ae50ee5d79d86', 'request_id': 'req-9bb9d94f-dc9c-47f8-9367-7567978e42fd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.128580 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffd8f72f0754d8c987ae50ee5d79d86', 'request_id': 'req-9bb9d94f-dc9c-47f8-9367-7567978e42fd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.140361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] The token cache is being invalidate because project 2ffd8f72f0754d8c987ae50ee5d79d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:17:50.140649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.141299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.143012 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1215/2455] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:17:49 2022] DELETE /identity/v3/projects/2ffd8f72f0754d8c987ae50ee5d79d86 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:50.146758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.148267 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:50.163785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a8f4-bcb7-4fa9-bacd-af88ec79e204 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.218896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.219542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.219818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.220094 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] PATH_INFO: `/v3/users/e64d99b595e24d28a968e5b6c50c79ba` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.221194 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64d99b595e24d28a968e5b6c50c79ba)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.223089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.267342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64d99b595e24d28a968e5b6c50c79ba'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.268003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64d99b595e24d28a968e5b6c50c79ba'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.280495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64d99b595e24d28a968e5b6c50c79ba'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.281122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64d99b595e24d28a968e5b6c50c79ba'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.287905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6deae9f5-c9c0-4a54-ac87-ec43757d86ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64d99b595e24d28a968e5b6c50c79ba'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.301390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1241/2456] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:17:50 2022] DELETE /identity/v3/users/e64d99b595e24d28a968e5b6c50c79ba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:50.471539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.473095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:50.487792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d94f-dc9c-47f8-9367-7567978e42fd admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.501252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:50.548031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.548681 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.548956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.549224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] PATH_INFO: `/v3/projects/84811d8171d4438aa9e6381626f986ed` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.550333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84811d8171d4438aa9e6381626f986ed)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.552269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.599144 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84811d8171d4438aa9e6381626f986ed', 'request_id': 'req-ba0abb26-5b29-43ff-b6a9-029351ab7f74'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.606273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84811d8171d4438aa9e6381626f986ed', 'request_id': 'req-ba0abb26-5b29-43ff-b6a9-029351ab7f74'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.611939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84811d8171d4438aa9e6381626f986ed', 'request_id': 'req-ba0abb26-5b29-43ff-b6a9-029351ab7f74'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.623259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] The token cache is being invalidate because project 84811d8171d4438aa9e6381626f986ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:17:50.623581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.624229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ba0abb26-5b29-43ff-b6a9-029351ab7f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:17:50.625684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1216/2457] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:17:50 2022] DELETE /identity/v3/projects/84811d8171d4438aa9e6381626f986ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:50.630561 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd6a8-fccb-48d7-b44b-4988376b4960 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.630868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd6a8-fccb-48d7-b44b-4988376b4960 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.631182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd6a8-fccb-48d7-b44b-4988376b4960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.650715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-94ffd6a8-fccb-48d7-b44b-4988376b4960 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:50.651873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-94ffd6a8-fccb-48d7-b44b-4988376b4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:50.669947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:50.712111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1242/2458] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:50.720015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c716-c930-40c7-9c74-c0f464440eba None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.720015 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c716-c930-40c7-9c74-c0f464440eba None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.721540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c716-c930-40c7-9c74-c0f464440eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.739582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8e32c716-c930-40c7-9c74-c0f464440eba None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:50.740770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8e32c716-c930-40c7-9c74-c0f464440eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:50.749148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1217/2459] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:50.753364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffd6a8-fccb-48d7-b44b-4988376b4960 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.763698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffd6a8-fccb-48d7-b44b-4988376b4960 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.768226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.768817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.769095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.769367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.770008 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:17:50.770307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.771930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.783462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1243/2460] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:17:50.787671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32c716-c930-40c7-9c74-c0f464440eba None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.797410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32c716-c930-40c7-9c74-c0f464440eba None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.802044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.802631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.802943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.803215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.803871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.806361 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.838669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1218/2461] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:17:50 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:17:50.840069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.850038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657c63d-802e-41f7-875d-bea3c556bbe7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.905903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.906423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.906698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.906967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.907620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.909515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.931642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1244/2462] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:17:50 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:17:50.935942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.946220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4180-6540-43e5-8d92-f96df226a039 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.950826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.951439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.951727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.951998 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.952640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.954231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.964075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1219/2463] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:50.967897 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:50.978268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd181e2-68c7-4a1d-9ceb-f2a0f8c0678e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:50.983064 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfced086-f975-4c86-ac2c-89ea8e120415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:50.983765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfced086-f975-4c86-ac2c-89ea8e120415 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:50.983967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfced086-f975-4c86-ac2c-89ea8e120415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:50.984238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfced086-f975-4c86-ac2c-89ea8e120415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:50.984876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfced086-f975-4c86-ac2c-89ea8e120415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:50.986660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfced086-f975-4c86-ac2c-89ea8e120415 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:50.997239 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1245/2464] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:51.001227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.011609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0b1ec-2f92-48b2-9bc6-fdbcee2b600c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.016216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.016848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.017127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.017398 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] PATH_INFO: `/v3/projects/e679f853d12b42278fa63fb95f72e244/users/83d8b9344a764c6e802b5f001331e8b0/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.032168 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e679f853d12b42278fa63fb95f72e244, user_id=83d8b9344a764c6e802b5f001331e8b0, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.034847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.048373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1220/2465] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:51 2022] PUT /identity/v3/projects/e679f853d12b42278fa63fb95f72e244/users/83d8b9344a764c6e802b5f001331e8b0/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:51.059108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12643c13-8b74-4740-9794-a17f617f95bc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.059392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12643c13-8b74-4740-9794-a17f617f95bc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.059701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12643c13-8b74-4740-9794-a17f617f95bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.087736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-12643c13-8b74-4740-9794-a17f617f95bc None None] MFA Rules not processed for user `83d8b9344a764c6e802b5f001331e8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:51.088936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-12643c13-8b74-4740-9794-a17f617f95bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:51.155594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1246/2466] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:51.160276 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.207770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:51.228439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bbf80-4b81-492d-bf18-f2b894918091 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.233170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.233771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.234050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.234317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.234944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.237274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.266009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1221/2467] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:17:51 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:17:51.270218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12643c13-8b74-4740-9794-a17f617f95bc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.281401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12643c13-8b74-4740-9794-a17f617f95bc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.298823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:51.339096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.339728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.340002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.340271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.340884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.342769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.363616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1247/2468] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:17:51 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:17:51.367653 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.378214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beab796-b688-4021-b896-30055abab6d9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.382854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.383477 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.383840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.384274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.385001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.386892 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.397294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1222/2469] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:51.402283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.412089 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d41db-ce2a-430f-93ef-20ed02a735cd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.417326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.417967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.418247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.418520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] PATH_INFO: `/v3/projects/e7286182a8b443eab2d3352a88ce8f5b/users/a2a5a9403a9b4ac5b9bf55a3b1dd1055/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.432704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7286182a8b443eab2d3352a88ce8f5b, user_id=a2a5a9403a9b4ac5b9bf55a3b1dd1055, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.435345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.448053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1248/2470] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:51 2022] PUT /identity/v3/projects/e7286182a8b443eab2d3352a88ce8f5b/users/a2a5a9403a9b4ac5b9bf55a3b1dd1055/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:51.451950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.461683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a14c0-faef-4d4e-8fc7-14a4966ce9ad admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.518107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583fd42-b8d9-4d41-8791-3799e606236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.518702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583fd42-b8d9-4d41-8791-3799e606236e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.518976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583fd42-b8d9-4d41-8791-3799e606236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.519247 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583fd42-b8d9-4d41-8791-3799e606236e admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.519954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583fd42-b8d9-4d41-8791-3799e606236e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.521610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583fd42-b8d9-4d41-8791-3799e606236e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.531765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1223/2471] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:17:51.535886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.545759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9b128-7b26-48e4-a930-76bf2b338258 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.550211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.550841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.551115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.551380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] PATH_INFO: `/v3/projects/e7286182a8b443eab2d3352a88ce8f5b/users/a2a5a9403a9b4ac5b9bf55a3b1dd1055/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.553274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7286182a8b443eab2d3352a88ce8f5b, user_id=a2a5a9403a9b4ac5b9bf55a3b1dd1055, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.555998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.566025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1249/2472] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:17:51 2022] PUT /identity/v3/projects/e7286182a8b443eab2d3352a88ce8f5b/users/a2a5a9403a9b4ac5b9bf55a3b1dd1055/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:17:51.577582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b97dca-ee2a-4f6c-9696-cb073eb86375 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.577866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b97dca-ee2a-4f6c-9696-cb073eb86375 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.578141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b97dca-ee2a-4f6c-9696-cb073eb86375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.605663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a7b97dca-ee2a-4f6c-9696-cb073eb86375 None None] MFA Rules not processed for user `a2a5a9403a9b4ac5b9bf55a3b1dd1055`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:51.606859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a7b97dca-ee2a-4f6c-9696-cb073eb86375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:51.672354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1224/2473] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:51.683228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.684939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:51.743154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5113-5a7d-4eee-a579-5fca7b6020cb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.746879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84230bd-7955-4c68-9028-6c10f17e5c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.747520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84230bd-7955-4c68-9028-6c10f17e5c86 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.747793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84230bd-7955-4c68-9028-6c10f17e5c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.748059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84230bd-7955-4c68-9028-6c10f17e5c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.756681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84230bd-7955-4c68-9028-6c10f17e5c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.758098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84230bd-7955-4c68-9028-6c10f17e5c86 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.767747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1250/2474] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:51.843859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b97dca-ee2a-4f6c-9696-cb073eb86375 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:51.855088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b97dca-ee2a-4f6c-9696-cb073eb86375 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:51.860035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:51.860643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:51.860920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:51.861190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:51.896369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:17:51.920976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:51.922492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:51.932565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1225/2475] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:17:53.401550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:53.402086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:53.402086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:53.421521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] MFA Rules not processed for user `b83b1a254074456897dcb9430e29d4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:17:53.422755 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:53.495039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1251/2476] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:17:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:17:53.941787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:17:53.943256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:53.955177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b370-0609-4319-854d-c4d8b8e7d4b8 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:17:53.959110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:17:53.959744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:17:53.960024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:17:53.960301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:17:53.962055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:17:54.028507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:17:54.029988 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:17:54.039887 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1226/2477] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:17:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:03.484885 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:04.035334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=41 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:12.745509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:12.747124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:12.810104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e738e7-9f70-4b9d-b565-2269e7508d9d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:12.813933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feda47-ec9b-416f-a9d3-70ac28708ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:12.814542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feda47-ec9b-416f-a9d3-70ac28708ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:12.814816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feda47-ec9b-416f-a9d3-70ac28708ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:12.815082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feda47-ec9b-416f-a9d3-70ac28708ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:12.816898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-94feda47-ec9b-416f-a9d3-70ac28708ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:12.875889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94feda47-ec9b-416f-a9d3-70ac28708ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:12.877299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94feda47-ec9b-416f-a9d3-70ac28708ce6 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:12.886837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1252/2478] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:21.225930 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:21.227385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:21.293825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72646f-f0eb-41b8-901b-776fc8b03c13 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:21.298514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:21.299149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:21.299441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:21.299736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] PATH_INFO: `/v3/users/2ca064552425428ebad9df458324275f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:21.300902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca064552425428ebad9df458324275f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:21.302868 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:21.354138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca064552425428ebad9df458324275f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:21.366023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca064552425428ebad9df458324275f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:21.373489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca064552425428ebad9df458324275f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:21.375651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca064552425428ebad9df458324275f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:21.375955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca064552425428ebad9df458324275f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:21.392170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1227/2479] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:21 2022] DELETE /identity/v3/users/2ca064552425428ebad9df458324275f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:21.397286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:21.397834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:21.398158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:21.417439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:21.418985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:21.499447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1253/2480] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:21.507050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:21.508630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:21.571708 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:21.573912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:21.595448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf2c8-c7c4-48e9-8dc1-a63fff472067 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:21.599504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:21.600357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:21.600357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:21.600591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:21.610601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:21.612267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:21.622718 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1228/2481] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:21.651037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887c275-9e90-412e-b8a3-5dbf2da1d855 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:21.656065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:21.656225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:21.656436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:21.656701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:21.659403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:21.671670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:21.673499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:21.678759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:21.687121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1254/2482] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:21.843705 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:21.852617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54f24-98ba-4a09-b7c5-1559ca39adde service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:21.856539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:21.857164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:21.857603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:21.857885 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:21.859701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:21.881106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:21.927549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:21.929000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:21.939973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1229/2483] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:22.099838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:22.101870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:22.114587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c00b7-a08b-42bd-8d99-626d503dd727 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:22.120560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:22.121410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:22.121861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:22.122290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] PATH_INFO: `/v3/projects/3a14d04f60c6465f973aba037d2dc0c5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:22.123733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a14d04f60c6465f973aba037d2dc0c5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:22.125810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:22.199534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a14d04f60c6465f973aba037d2dc0c5', 'request_id': 'req-8a023792-abe5-49e4-9489-eae38b076676'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.212031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a14d04f60c6465f973aba037d2dc0c5', 'request_id': 'req-8a023792-abe5-49e4-9489-eae38b076676'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.219264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a14d04f60c6465f973aba037d2dc0c5', 'request_id': 'req-8a023792-abe5-49e4-9489-eae38b076676'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.239608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] The token cache is being invalidate because project 3a14d04f60c6465f973aba037d2dc0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:22.239949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.241247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.242798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1255/2484] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:22 2022] DELETE /identity/v3/projects/3a14d04f60c6465f973aba037d2dc0c5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:22.247748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:22.258393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66bfd-5aca-4b6e-8122-fcf718b87efa service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:22.329986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:22.331042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:22.331585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:22.332118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] PATH_INFO: `/v3/users/93877ce0cdd748e9930ed4e9b76c130f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:22.333760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93877ce0cdd748e9930ed4e9b76c130f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:22.337656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:22.402696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93877ce0cdd748e9930ed4e9b76c130f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.421350 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93877ce0cdd748e9930ed4e9b76c130f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.434514 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93877ce0cdd748e9930ed4e9b76c130f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.435575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93877ce0cdd748e9930ed4e9b76c130f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.436747 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a8259b5-2925-43a9-831a-187a5a562cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93877ce0cdd748e9930ed4e9b76c130f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:22.458896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1230/2485] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:22 2022] DELETE /identity/v3/users/93877ce0cdd748e9930ed4e9b76c130f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:23.144748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:23.151059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:23.187718 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023792-abe5-49e4-9489-eae38b076676 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:23.279992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:23.280672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.280945 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.281218 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] PATH_INFO: `/v3/projects/b29d504a08674888bbe05859ab04b591` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.282367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29d504a08674888bbe05859ab04b591)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:23.284486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:23.361114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29d504a08674888bbe05859ab04b591', 'request_id': 'req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:23.369284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29d504a08674888bbe05859ab04b591', 'request_id': 'req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:23.376109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29d504a08674888bbe05859ab04b591', 'request_id': 'req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:23.392253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] The token cache is being invalidate because project b29d504a08674888bbe05859ab04b591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:23.392545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:23.393256 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c67e9a31-a1fb-4fc1-99f6-3fd7b66a3c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:23.395079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1256/2486] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:23 2022] DELETE /identity/v3/projects/b29d504a08674888bbe05859ab04b591 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:23.399879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6929aa-5c68-40ee-a1cf-c4229d2f0895 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.400935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6929aa-5c68-40ee-a1cf-c4229d2f0895 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.401236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6929aa-5c68-40ee-a1cf-c4229d2f0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.426328 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2c6929aa-5c68-40ee-a1cf-c4229d2f0895 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:23.427532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2c6929aa-5c68-40ee-a1cf-c4229d2f0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:23.466439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:23.507562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1231/2487] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:23.515053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c910b-a2a1-4dc1-b942-2173eecd03d7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.515339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c910b-a2a1-4dc1-b942-2173eecd03d7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.515650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c910b-a2a1-4dc1-b942-2173eecd03d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.536888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b78c910b-a2a1-4dc1-b942-2173eecd03d7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:23.538132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b78c910b-a2a1-4dc1-b942-2173eecd03d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:23.548581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1257/2488] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:23.552365 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6929aa-5c68-40ee-a1cf-c4229d2f0895 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:23.565789 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6929aa-5c68-40ee-a1cf-c4229d2f0895 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:23.572342 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:23.573064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.574213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.574213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.574730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:23.575174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:23.577690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:23.598126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1232/2489] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:18:23.602620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c910b-a2a1-4dc1-b942-2173eecd03d7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:23.610156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:23.614528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c910b-a2a1-4dc1-b942-2173eecd03d7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:23.621914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:23.622907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.623407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.623958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.624981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:23.627342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:23.668906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:23.682340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6130a-a15b-41ea-84c8-dc5e4fd88c2f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:23.683120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1258/2490] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:23 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:23.768663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:23.769337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.769611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.769874 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.770692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:23.773067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:23.801775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1233/2491] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:23 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:23.805240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:23.818493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4179-9d52-4c4d-93a3-57a17be39f7d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:23.825164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:23.826068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.826205 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.826469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.827121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:23.829416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:23.851697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1259/2492] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:18:23.852763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:23.863970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd1cd-3a63-4b93-ac1e-e59554e79129 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:23.869777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5c5a4-7484-4fe7-868c-6b28dba39f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:23.870880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5c5a4-7484-4fe7-868c-6b28dba39f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.870880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5c5a4-7484-4fe7-868c-6b28dba39f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.870880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5c5a4-7484-4fe7-868c-6b28dba39f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.871600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5c5a4-7484-4fe7-868c-6b28dba39f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:23.873394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5c5a4-7484-4fe7-868c-6b28dba39f05 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:23.894902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1234/2493] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:23.898932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:23.910795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2126f-57bf-488d-bf36-e7e569870634 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:23.916070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:23.916763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.917047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.917506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] PATH_INFO: `/v3/projects/38bbfe6061b2479b9f17e82fdbd8d467/users/d2845084c0154372adc55ea31b2a0c54/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:23.935521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bbfe6061b2479b9f17e82fdbd8d467, user_id=d2845084c0154372adc55ea31b2a0c54, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:23.938920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:23.959367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1260/2494] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:23 2022] PUT /identity/v3/projects/38bbfe6061b2479b9f17e82fdbd8d467/users/d2845084c0154372adc55ea31b2a0c54/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:23.972624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf269e-ae78-4dcc-932b-b34848af0bc4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:23.972896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf269e-ae78-4dcc-932b-b34848af0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:23.973172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf269e-ae78-4dcc-932b-b34848af0bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.013202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2fdf269e-ae78-4dcc-932b-b34848af0bc4 None None] MFA Rules not processed for user `d2845084c0154372adc55ea31b2a0c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:24.014583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2fdf269e-ae78-4dcc-932b-b34848af0bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:24.112175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1235/2495] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:24.117266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:24.203748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ffc1-4129-4115-ae0f-f9f32412db6c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:24.211130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:24.212341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:24.213381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:24.213748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.215200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:24.217553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:24.265596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf269e-ae78-4dcc-932b-b34848af0bc4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:24.273796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1261/2496] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:24 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:24.281841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf269e-ae78-4dcc-932b-b34848af0bc4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:24.345592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:24.401469 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:24.405479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:24.405867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:24.407783 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.408612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:24.411024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:24.463817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1236/2497] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:24 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:24.467747 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:24.478527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaa0e0-3892-4084-8b2f-6c2f5baf03d7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:24.483352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:24.484110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:24.484386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:24.484650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.485281 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:24.486858 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:24.498459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1262/2498] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:24.502491 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:24.513358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594269c5-ec61-4e24-99f5-300a9f028c98 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:24.519346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ffdb9-5ee4-4b5d-bae2-dc9bb12a4bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:24.519986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffdb9-5ee4-4b5d-bae2-dc9bb12a4bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:24.520260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffdb9-5ee4-4b5d-bae2-dc9bb12a4bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:24.520531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffdb9-5ee4-4b5d-bae2-dc9bb12a4bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.521175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ffdb9-5ee4-4b5d-bae2-dc9bb12a4bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:24.522795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ffdb9-5ee4-4b5d-bae2-dc9bb12a4bd1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:24.537897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1237/2499] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:24.539265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:24.550033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64abd33-a325-4acb-a225-bf94952e8d8c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:24.556051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:24.557048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:24.557366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:24.557527 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] PATH_INFO: `/v3/projects/d426abaf30114e6faafe7d71d6ea6752/users/06b02062814f462cbdc8ae98797114f2/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.575604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d426abaf30114e6faafe7d71d6ea6752, user_id=06b02062814f462cbdc8ae98797114f2, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:24.578246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:24.596846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1263/2500] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:24 2022] PUT /identity/v3/projects/d426abaf30114e6faafe7d71d6ea6752/users/06b02062814f462cbdc8ae98797114f2/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:24.607164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a418e-293a-463d-825e-9c828a07b135 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:24.607672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a418e-293a-463d-825e-9c828a07b135 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:24.608036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a418e-293a-463d-825e-9c828a07b135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.649649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c21a418e-293a-463d-825e-9c828a07b135 None None] MFA Rules not processed for user `06b02062814f462cbdc8ae98797114f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:24.652409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c21a418e-293a-463d-825e-9c828a07b135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:24.739142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1238/2501] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:24.744467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:24.837131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:24.843308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3947d-aa52-4534-a587-53629dc98710 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:24.849456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:24.850453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:24.851027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:24.851506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:24.852320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:24.855604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:24.902283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1264/2502] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:24 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:24.923293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a418e-293a-463d-825e-9c828a07b135 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:24.934752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a418e-293a-463d-825e-9c828a07b135 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:25.000092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:25.000813 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:25.001159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:25.001524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:25.002225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:25.004464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:25.033073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1239/2503] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:24 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:25.037325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:25.060244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20035c4-cbcb-458e-adfc-9aa980ede4d2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:25.065917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:25.067121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:25.068216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:25.068671 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:25.069992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:25.072273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:25.087367 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1265/2504] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:25.092630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:25.114179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40378385-675b-4529-ab28-c938ee6bb5c9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:25.122765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:25.123521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:25.123802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:25.124080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] PATH_INFO: `/v3/projects/b1d7a94666a44711b82311abb5a108fe/users/3eb8394fab524cb4bf354908bd8c90ff/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:25.143390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d7a94666a44711b82311abb5a108fe, user_id=3eb8394fab524cb4bf354908bd8c90ff, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:25.148249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:25.174824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1240/2505] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:25 2022] PUT /identity/v3/projects/b1d7a94666a44711b82311abb5a108fe/users/3eb8394fab524cb4bf354908bd8c90ff/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:25.175998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:25.192450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f93be-f7d1-41f7-931e-c329ee2b2822 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:25.311887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a29049-07c6-4559-8ada-187735e4b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:25.312650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a29049-07c6-4559-8ada-187735e4b416 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:25.313025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a29049-07c6-4559-8ada-187735e4b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:25.313856 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a29049-07c6-4559-8ada-187735e4b416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:25.314616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a29049-07c6-4559-8ada-187735e4b416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:25.316681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a29049-07c6-4559-8ada-187735e4b416 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:25.347466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1266/2506] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:25.351866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:25.360809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:25.373211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a714-9e3b-44e7-93a5-5e399e71208f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:25.382548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:25.383224 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:25.384921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:25.385202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] PATH_INFO: `/v3/projects/b1d7a94666a44711b82311abb5a108fe/users/3eb8394fab524cb4bf354908bd8c90ff/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:25.388206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d7a94666a44711b82311abb5a108fe, user_id=3eb8394fab524cb4bf354908bd8c90ff, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:25.391161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:25.411938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1241/2507] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:25 2022] PUT /identity/v3/projects/b1d7a94666a44711b82311abb5a108fe/users/3eb8394fab524cb4bf354908bd8c90ff/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:25.423304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae61db-7f7f-4b16-bf22-6f7a2c6aabf4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:25.423660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae61db-7f7f-4b16-bf22-6f7a2c6aabf4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:25.424728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae61db-7f7f-4b16-bf22-6f7a2c6aabf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:25.483637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2aae61db-7f7f-4b16-bf22-6f7a2c6aabf4 None None] MFA Rules not processed for user `3eb8394fab524cb4bf354908bd8c90ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:25.484950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2aae61db-7f7f-4b16-bf22-6f7a2c6aabf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:25.579625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1267/2508] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:25.593766 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:25.596320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:25.742409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72d000-be35-4e3b-899c-3a196fd25013 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:25.746692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:25.747482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:25.747823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:25.748165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:25.769561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:25.771153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:25.796387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1242/2509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:26.468330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae61db-7f7f-4b16-bf22-6f7a2c6aabf4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:26.477884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae61db-7f7f-4b16-bf22-6f7a2c6aabf4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:26.481833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:26.482468 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:26.482744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:26.483070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:26.532894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:26.543615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:26.545044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:26.553989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1268/2510] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:29.445085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:29.446585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:29.516851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309ff1-b53c-42d0-aabf-20c16992d197 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:29.521329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:29.522044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:29.522320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:29.522589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] PATH_INFO: `/v3/users/d4e3d425e2e54e4d879ab4399f914361` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:29.523732 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e3d425e2e54e4d879ab4399f914361)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:29.525902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:29.578963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e3d425e2e54e4d879ab4399f914361'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.591179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e3d425e2e54e4d879ab4399f914361'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.598101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e3d425e2e54e4d879ab4399f914361'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.598782 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e3d425e2e54e4d879ab4399f914361'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.599387 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e3d425e2e54e4d879ab4399f914361'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.612351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1243/2511] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:29 2022] DELETE /identity/v3/users/d4e3d425e2e54e4d879ab4399f914361 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:29.781557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:29.794109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb453d0-753e-4eeb-bdce-3380e0cfbf3e service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:29.850543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:29.851152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:29.851459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:29.851735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] PATH_INFO: `/v3/projects/eff7843b47d94d9d96b23e659a61e2ae` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:29.852844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff7843b47d94d9d96b23e659a61e2ae)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:29.855254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:29.901560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff7843b47d94d9d96b23e659a61e2ae', 'request_id': 'req-81b5dd44-0ed1-423d-9df1-87b51dfec756'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.907664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff7843b47d94d9d96b23e659a61e2ae', 'request_id': 'req-81b5dd44-0ed1-423d-9df1-87b51dfec756'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.913513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff7843b47d94d9d96b23e659a61e2ae', 'request_id': 'req-81b5dd44-0ed1-423d-9df1-87b51dfec756'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.927379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] The token cache is being invalidate because project eff7843b47d94d9d96b23e659a61e2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:29.927736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.928386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:29.930203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1269/2512] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:29 2022] DELETE /identity/v3/projects/eff7843b47d94d9d96b23e659a61e2ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:29.934769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:29.936256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:29.954696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8060fb-cd03-4534-a6e9-a420c7a6b153 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:29.964116 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:30.025279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:30.025963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:30.026186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:30.026446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] PATH_INFO: `/v3/users/4d16aa4d3b124d6494e7d761ac9e5ca2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:30.027635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d16aa4d3b124d6494e7d761ac9e5ca2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:30.029677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:30.089101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d16aa4d3b124d6494e7d761ac9e5ca2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.104753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d16aa4d3b124d6494e7d761ac9e5ca2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.112411 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d16aa4d3b124d6494e7d761ac9e5ca2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.113557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d16aa4d3b124d6494e7d761ac9e5ca2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.113735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d16aa4d3b124d6494e7d761ac9e5ca2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.127575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1244/2513] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:29 2022] DELETE /identity/v3/users/4d16aa4d3b124d6494e7d761ac9e5ca2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:30.338079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:30.340123 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:30.364618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd44-0ed1-423d-9df1-87b51dfec756 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:30.435345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:30.436023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:30.436303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:30.436582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] PATH_INFO: `/v3/projects/76d68afeb0874e2cbbcc8a989993f6a1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:30.437701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d68afeb0874e2cbbcc8a989993f6a1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:30.440016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:30.467365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:30.498171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d68afeb0874e2cbbcc8a989993f6a1', 'request_id': 'req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.505721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d68afeb0874e2cbbcc8a989993f6a1', 'request_id': 'req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.512143 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d68afeb0874e2cbbcc8a989993f6a1', 'request_id': 'req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.524752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] The token cache is being invalidate because project 76d68afeb0874e2cbbcc8a989993f6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:30.525746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.526675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:30.528812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1270/2514] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:30 2022] DELETE /identity/v3/projects/76d68afeb0874e2cbbcc8a989993f6a1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:32.817310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:32.819458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:32.889877 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886eb5d-ee07-49be-8d23-de785e5df838 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:32.943262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:32.949935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853368b-0372-44ee-823b-50aa2037c695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:32.950634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853368b-0372-44ee-823b-50aa2037c695 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:32.950963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853368b-0372-44ee-823b-50aa2037c695 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:32.951464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853368b-0372-44ee-823b-50aa2037c695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:32.955309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d853368b-0372-44ee-823b-50aa2037c695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:33.019339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853368b-0372-44ee-823b-50aa2037c695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:33.020924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853368b-0372-44ee-823b-50aa2037c695 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:33.035191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1245/2515] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:35.153958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:35.155515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:35.222830 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a657aa-5cde-4fbe-8ffc-75aa369b21d0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:35.227770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:35.228398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:35.228679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:35.228979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] PATH_INFO: `/v3/users/d2845084c0154372adc55ea31b2a0c54` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:35.230537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2845084c0154372adc55ea31b2a0c54)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:35.232498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:35.281149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2845084c0154372adc55ea31b2a0c54'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.281991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2845084c0154372adc55ea31b2a0c54'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.300973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2845084c0154372adc55ea31b2a0c54'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.301729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2845084c0154372adc55ea31b2a0c54'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.314750 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2845084c0154372adc55ea31b2a0c54'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.328177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1271/2516] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:35 2022] DELETE /identity/v3/users/d2845084c0154372adc55ea31b2a0c54 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:35.332747 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:35.333200 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:35.333327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:35.352713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:35.353902 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:35.412295 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1246/2517] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:35.422549 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:35.423985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:35.460139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:35.485989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec8881-a001-419e-b0c4-dcd2ad246748 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:35.489559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:35.490157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:35.490429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:35.490698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:35.500624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:35.502052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:35.512580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1272/2518] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:35.796259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:35.797751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:35.810878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e040-8b8c-45d0-86fb-cdfcb13d6b14 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:35.816333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:35.816941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:35.817265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:35.817538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] PATH_INFO: `/v3/projects/38bbfe6061b2479b9f17e82fdbd8d467` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:35.818651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38bbfe6061b2479b9f17e82fdbd8d467)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:35.820576 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:35.867833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38bbfe6061b2479b9f17e82fdbd8d467', 'request_id': 'req-f8951e3d-f391-4d32-b5f9-09f7770c4d61'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.875742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38bbfe6061b2479b9f17e82fdbd8d467', 'request_id': 'req-f8951e3d-f391-4d32-b5f9-09f7770c4d61'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.881355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38bbfe6061b2479b9f17e82fdbd8d467', 'request_id': 'req-f8951e3d-f391-4d32-b5f9-09f7770c4d61'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.892271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] The token cache is being invalidate because project 38bbfe6061b2479b9f17e82fdbd8d467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:35.892556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.893179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:35.894650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1247/2519] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:35 2022] DELETE /identity/v3/projects/38bbfe6061b2479b9f17e82fdbd8d467 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:35.898613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:35.908506 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcea4f0-d4e9-43fe-bb8c-a35fc7d40de3 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:35.963892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:35.964770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:35.964988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:35.965261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] PATH_INFO: `/v3/users/06b02062814f462cbdc8ae98797114f2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:35.966376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b02062814f462cbdc8ae98797114f2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:35.968322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:36.013965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b02062814f462cbdc8ae98797114f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.014600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b02062814f462cbdc8ae98797114f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.025943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b02062814f462cbdc8ae98797114f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.027131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b02062814f462cbdc8ae98797114f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.033735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b02062814f462cbdc8ae98797114f2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.048051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1273/2520] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:35 2022] DELETE /identity/v3/users/06b02062814f462cbdc8ae98797114f2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:36.326086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:36.327691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:36.357475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951e3d-f391-4d32-b5f9-09f7770c4d61 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:36.384090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:36.420358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:36.420886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:36.421165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:36.421432 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] PATH_INFO: `/v3/projects/d426abaf30114e6faafe7d71d6ea6752` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:36.422606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d426abaf30114e6faafe7d71d6ea6752)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:36.424667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:36.472758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd426abaf30114e6faafe7d71d6ea6752', 'request_id': 'req-b83f3266-be55-42d4-aca3-8cbba8922b91'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.481175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd426abaf30114e6faafe7d71d6ea6752', 'request_id': 'req-b83f3266-be55-42d4-aca3-8cbba8922b91'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.486900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd426abaf30114e6faafe7d71d6ea6752', 'request_id': 'req-b83f3266-be55-42d4-aca3-8cbba8922b91'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.498008 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] The token cache is being invalidate because project d426abaf30114e6faafe7d71d6ea6752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:36.498303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.498952 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.500478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1248/2521] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:36 2022] DELETE /identity/v3/projects/d426abaf30114e6faafe7d71d6ea6752 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:36.504526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:36.505933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:36.518951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ccca4-6491-404f-a5bf-bb22c64f1928 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:36.566680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:36.577253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:36.577881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:36.578156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:36.578450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] PATH_INFO: `/v3/users/3eb8394fab524cb4bf354908bd8c90ff` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:36.579615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb8394fab524cb4bf354908bd8c90ff)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:36.581579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:36.625837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb8394fab524cb4bf354908bd8c90ff'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.626477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb8394fab524cb4bf354908bd8c90ff'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.638789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb8394fab524cb4bf354908bd8c90ff'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.639509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb8394fab524cb4bf354908bd8c90ff'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.646386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-62a8b918-073d-42d1-ab1d-7890971de99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb8394fab524cb4bf354908bd8c90ff'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:36.658809 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1274/2522] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:36 2022] DELETE /identity/v3/users/3eb8394fab524cb4bf354908bd8c90ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:36.936476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:36.937973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:36.953922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f3266-be55-42d4-aca3-8cbba8922b91 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.011604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.012231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.012510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.012784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] PATH_INFO: `/v3/projects/b1d7a94666a44711b82311abb5a108fe` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.013906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d7a94666a44711b82311abb5a108fe)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.016149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.061043 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d7a94666a44711b82311abb5a108fe', 'request_id': 'req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:37.068484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d7a94666a44711b82311abb5a108fe', 'request_id': 'req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:37.070439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:37.075830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d7a94666a44711b82311abb5a108fe', 'request_id': 'req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:37.088353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] The token cache is being invalidate because project b1d7a94666a44711b82311abb5a108fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:37.088666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:37.089629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-827b75ce-fc0b-45ac-abb4-9aaab2d8e8e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:37.091162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1249/2523] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:36 2022] DELETE /identity/v3/projects/b1d7a94666a44711b82311abb5a108fe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:37.099057 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0ace-6cc0-4347-a97a-af10949fceda None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.099570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0ace-6cc0-4347-a97a-af10949fceda None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.100161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0ace-6cc0-4347-a97a-af10949fceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.124231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e63f0ace-6cc0-4347-a97a-af10949fceda None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:37.125436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e63f0ace-6cc0-4347-a97a-af10949fceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:37.185768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1275/2524] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:37.194422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d06a-3d05-4af3-8fd1-438c5a197b6c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.194706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d06a-3d05-4af3-8fd1-438c5a197b6c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.194983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d06a-3d05-4af3-8fd1-438c5a197b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.275424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a2c6d06a-3d05-4af3-8fd1-438c5a197b6c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:37.277251 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2c6d06a-3d05-4af3-8fd1-438c5a197b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:37.328299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1250/2525] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:37.332620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0ace-6cc0-4347-a97a-af10949fceda None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.383207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0ace-6cc0-4347-a97a-af10949fceda None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.387827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.388422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.388696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.388962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.389589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:37.389884 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.391513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.402408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1276/2526] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:18:37.406696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6d06a-3d05-4af3-8fd1-438c5a197b6c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.415650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6d06a-3d05-4af3-8fd1-438c5a197b6c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.421055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.421677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.421953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.422222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.422879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.424817 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.451805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1251/2527] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:37 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:37.455823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.465557 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b598685-e522-420e-9bd5-d9c07f6fbc42 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.482088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:37.524958 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.525552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.525823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.526651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.527469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.529387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.551452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1277/2528] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:37 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:37.555684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.566406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358aa4f-2b7f-4e99-aa68-dc6fa83e1996 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.570975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.571677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.571956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.572227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.572870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.574504 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.584380 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1252/2529] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:37.588501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.599238 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f65bd5-e0bc-4ffe-81f5-7468db03431f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.604090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1c598-b763-435f-84fc-f9b30c85513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.605392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1c598-b763-435f-84fc-f9b30c85513e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.605753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1c598-b763-435f-84fc-f9b30c85513e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.606025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1c598-b763-435f-84fc-f9b30c85513e admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.606665 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1c598-b763-435f-84fc-f9b30c85513e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.608339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1c598-b763-435f-84fc-f9b30c85513e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.618439 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1278/2530] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:37.622940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.632900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1a45-5528-4d15-bfa1-35fef7472b91 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.637604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.638261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.638539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.638812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] PATH_INFO: `/v3/projects/2821eb10d6984153af15d9780fccd723/users/bc174c2f09ff4ae684475ffe7f07fb5c/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.654360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2821eb10d6984153af15d9780fccd723, user_id=bc174c2f09ff4ae684475ffe7f07fb5c, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.657001 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.672470 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1253/2531] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:37 2022] PUT /identity/v3/projects/2821eb10d6984153af15d9780fccd723/users/bc174c2f09ff4ae684475ffe7f07fb5c/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:37.683908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974277b2-dd5c-473b-a52a-1198fbd5b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.684195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974277b2-dd5c-473b-a52a-1198fbd5b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.684467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974277b2-dd5c-473b-a52a-1198fbd5b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.711865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-974277b2-dd5c-473b-a52a-1198fbd5b7e8 None None] MFA Rules not processed for user `bc174c2f09ff4ae684475ffe7f07fb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:37.712973 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-974277b2-dd5c-473b-a52a-1198fbd5b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:37.777721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1279/2532] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:37.782259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.833263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:37.845465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3605a5-713d-47db-998a-f56339b8d503 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.850362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.850963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.851241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.851547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.852169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.854082 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.880410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1254/2533] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:37 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:37.884521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974277b2-dd5c-473b-a52a-1198fbd5b7e8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.895982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974277b2-dd5c-473b-a52a-1198fbd5b7e8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.951600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.952213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.952491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.952763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.953389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.955295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:37.975240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1280/2534] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:37 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:37.979171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:37.989971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f1c94-1866-4724-aec9-7c63e6b9ded9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:37.994560 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:37.995157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:37.995462 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:37.995741 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:37.997059 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:37.998665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:38.009204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1255/2535] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:38.013511 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:38.023236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d538a0-ff1b-4e53-adfd-8ede8726d5f6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:38.028268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:38.028915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:38.029195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:38.029469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] PATH_INFO: `/v3/projects/0ace74c9439f4cbb86aab33a1981622f/users/73e33f8585e440d5a630f6a63e947850/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:38.044570 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ace74c9439f4cbb86aab33a1981622f, user_id=73e33f8585e440d5a630f6a63e947850, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:38.047289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:38.049505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:38.061318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1281/2536] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:38 2022] PUT /identity/v3/projects/0ace74c9439f4cbb86aab33a1981622f/users/73e33f8585e440d5a630f6a63e947850/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:38.065487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:38.075346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d481-0012-486b-bbca-1fc2642a112e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:38.133668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b38b9-f929-461b-a9d4-564cd936d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:38.134271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b38b9-f929-461b-a9d4-564cd936d834 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:38.134547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b38b9-f929-461b-a9d4-564cd936d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:38.134815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b38b9-f929-461b-a9d4-564cd936d834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:38.135467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b38b9-f929-461b-a9d4-564cd936d834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:38.137266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b38b9-f929-461b-a9d4-564cd936d834 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:38.147105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1256/2537] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:38.152024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:38.162459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa25e-cef8-4438-9457-c0d74fc0eb62 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:38.167091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:38.167768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:38.168576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:38.168850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] PATH_INFO: `/v3/projects/0ace74c9439f4cbb86aab33a1981622f/users/73e33f8585e440d5a630f6a63e947850/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:38.170739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ace74c9439f4cbb86aab33a1981622f, user_id=73e33f8585e440d5a630f6a63e947850, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:38.173403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:38.184339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1282/2538] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:38 2022] PUT /identity/v3/projects/0ace74c9439f4cbb86aab33a1981622f/users/73e33f8585e440d5a630f6a63e947850/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:38.195840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfecf48-b317-4f88-84f7-f92a8506f20c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:38.196124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfecf48-b317-4f88-84f7-f92a8506f20c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:38.196396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfecf48-b317-4f88-84f7-f92a8506f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:38.231558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cbfecf48-b317-4f88-84f7-f92a8506f20c None None] MFA Rules not processed for user `73e33f8585e440d5a630f6a63e947850`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:38.232689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cbfecf48-b317-4f88-84f7-f92a8506f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:38.301337 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1257/2539] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:38.313012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:38.314947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:38.387091 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716b19-de73-4ee6-b18b-88218ab08974 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:38.390739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:38.391333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:38.391660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:38.391933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:38.400696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:38.402100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:38.411950 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1283/2540] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:38.493478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfecf48-b317-4f88-84f7-f92a8506f20c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:38.503189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfecf48-b317-4f88-84f7-f92a8506f20c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:38.506730 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980e2a4-55d9-4380-bc68-0c7c3a7833c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:38.507315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e2a4-55d9-4380-bc68-0c7c3a7833c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:38.507616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e2a4-55d9-4380-bc68-0c7c3a7833c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:38.507883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e2a4-55d9-4380-bc68-0c7c3a7833c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:38.552259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:38.565603 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980e2a4-55d9-4380-bc68-0c7c3a7833c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:38.567348 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980e2a4-55d9-4380-bc68-0c7c3a7833c7 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:38.576318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1258/2541] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:42.921171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:42.922643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:42.988444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09231985-e2d4-44cb-8308-b066dcb91b86 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:42.992944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:42.993564 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:42.993845 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:42.994116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] PATH_INFO: `/v3/users/83d8b9344a764c6e802b5f001331e8b0` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:42.995224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d8b9344a764c6e802b5f001331e8b0)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:42.997907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:43.051862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d8b9344a764c6e802b5f001331e8b0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.052550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d8b9344a764c6e802b5f001331e8b0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.066272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d8b9344a764c6e802b5f001331e8b0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.066983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d8b9344a764c6e802b5f001331e8b0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.072255 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:43.075857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d8b9344a764c6e802b5f001331e8b0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.089677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1284/2542] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:42 2022] DELETE /identity/v3/users/83d8b9344a764c6e802b5f001331e8b0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:43.094280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:43.094777 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:43.094879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:43.114285 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:43.115521 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:43.179792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1259/2543] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:43.190680 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:43.192132 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:43.248051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72fdb5-fd38-4043-bb34-244aa21f98c2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:43.251688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:43.252285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:43.252556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:43.252822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:43.261552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:43.263009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:43.272068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1285/2544] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:43.466198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:43.467637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:43.479727 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1bb62-45f9-4b44-be89-cf96ad3e44e5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:43.485519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:43.485801 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:43.486078 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:43.486409 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] PATH_INFO: `/v3/users/bc174c2f09ff4ae684475ffe7f07fb5c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:43.487935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc174c2f09ff4ae684475ffe7f07fb5c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:43.489648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:43.541173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc174c2f09ff4ae684475ffe7f07fb5c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.554749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc174c2f09ff4ae684475ffe7f07fb5c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.559442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:43.561006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:43.562745 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc174c2f09ff4ae684475ffe7f07fb5c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.563906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc174c2f09ff4ae684475ffe7f07fb5c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.564515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2814dd1f-805a-4d61-bc81-9d34790b5318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc174c2f09ff4ae684475ffe7f07fb5c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.576051 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249324b6-e48e-407b-93ba-70b16e180ac5 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:43.580978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:43.581696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:43.584668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1260/2545] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:43 2022] DELETE /identity/v3/users/bc174c2f09ff4ae684475ffe7f07fb5c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:43.584794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:43.584794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] PATH_INFO: `/v3/projects/e679f853d12b42278fa63fb95f72e244` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:43.584794 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e679f853d12b42278fa63fb95f72e244)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:43.586120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:43.587708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:43.589240 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:43.589568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:43.615442 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:43.616742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:43.644153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e679f853d12b42278fa63fb95f72e244', 'request_id': 'req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.650774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e679f853d12b42278fa63fb95f72e244', 'request_id': 'req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.656912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e679f853d12b42278fa63fb95f72e244', 'request_id': 'req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.670076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] The token cache is being invalidate because project e679f853d12b42278fa63fb95f72e244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:43.670369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.670990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.672543 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1286/2546] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:43 2022] DELETE /identity/v3/projects/e679f853d12b42278fa63fb95f72e244 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:43.672786 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:43.676446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:43.677795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:43.687140 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1261/2547] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:43.694146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:43.695506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:43.742795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4db60-6b15-4e9c-866b-04ebaff3e8bf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:43.748404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:43.749081 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:43.749368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:43.749638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] PATH_INFO: `/v3/users/a2a5a9403a9b4ac5b9bf55a3b1dd1055` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:43.750769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a5a9403a9b4ac5b9bf55a3b1dd1055)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:43.752764 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:43.753326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dcfa7-6092-47b2-84ed-04e3135b7a8f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:43.766999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:43.809900 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a5a9403a9b4ac5b9bf55a3b1dd1055'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.810130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:43.810829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:43.810970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a5a9403a9b4ac5b9bf55a3b1dd1055'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.811071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:43.811351 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:43.825749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a5a9403a9b4ac5b9bf55a3b1dd1055'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.825989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:43.826999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a5a9403a9b4ac5b9bf55a3b1dd1055'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.827323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:43.836553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a5a9403a9b4ac5b9bf55a3b1dd1055'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:43.838710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1262/2548] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:18:43.854317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1287/2549] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:43 2022] DELETE /identity/v3/users/a2a5a9403a9b4ac5b9bf55a3b1dd1055 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:44.192267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.193796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:44.207231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1470478-1638-4e6b-b248-9f20b170223b service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.244141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.246499 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:44.278788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.279434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.279719 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.279986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] PATH_INFO: `/v3/projects/2821eb10d6984153af15d9780fccd723` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.281114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2821eb10d6984153af15d9780fccd723)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.283035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.322581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d12f17-eeb1-4e18-a125-f0e45fb67c31 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.340888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2821eb10d6984153af15d9780fccd723', 'request_id': 'req-1096590a-31fe-44cc-bc34-45595eba70ac'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.349229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2821eb10d6984153af15d9780fccd723', 'request_id': 'req-1096590a-31fe-44cc-bc34-45595eba70ac'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.351321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:44.357430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2821eb10d6984153af15d9780fccd723', 'request_id': 'req-1096590a-31fe-44cc-bc34-45595eba70ac'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.369820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] The token cache is being invalidate because project 2821eb10d6984153af15d9780fccd723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:44.370112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.370762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.372422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1263/2550] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:44 2022] DELETE /identity/v3/projects/2821eb10d6984153af15d9780fccd723 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:44.376345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.377731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:44.383793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.384430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.384710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.384981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] PATH_INFO: `/v3/projects/e7286182a8b443eab2d3352a88ce8f5b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.386121 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7286182a8b443eab2d3352a88ce8f5b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.388214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.434663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:44.438878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7286182a8b443eab2d3352a88ce8f5b', 'request_id': 'req-ae7f1a40-f7e9-43e2-a356-d571791d1844'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.445707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096590a-31fe-44cc-bc34-45595eba70ac admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.447147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7286182a8b443eab2d3352a88ce8f5b', 'request_id': 'req-ae7f1a40-f7e9-43e2-a356-d571791d1844'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.454491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7286182a8b443eab2d3352a88ce8f5b', 'request_id': 'req-ae7f1a40-f7e9-43e2-a356-d571791d1844'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.468101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] The token cache is being invalidate because project e7286182a8b443eab2d3352a88ce8f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:44.468472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.469167 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae7f1a40-f7e9-43e2-a356-d571791d1844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.470715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1288/2551] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:44 2022] DELETE /identity/v3/projects/e7286182a8b443eab2d3352a88ce8f5b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:44.475403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb4c3-2ee4-4ee6-ad1e-742092029783 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.475716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb4c3-2ee4-4ee6-ad1e-742092029783 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.475991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb4c3-2ee4-4ee6-ad1e-742092029783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.495366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-69dfb4c3-2ee4-4ee6-ad1e-742092029783 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:44.496920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-69dfb4c3-2ee4-4ee6-ad1e-742092029783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:44.504768 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.505332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.505605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.505873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] PATH_INFO: `/v3/users/73e33f8585e440d5a630f6a63e947850` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.507126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e33f8585e440d5a630f6a63e947850)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.509126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.555940 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e33f8585e440d5a630f6a63e947850'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.558171 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1289/2552] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:44.566252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ef619-98a4-43d3-b8fb-62136dd8643d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.566532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ef619-98a4-43d3-b8fb-62136dd8643d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.566803 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ef619-98a4-43d3-b8fb-62136dd8643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.568690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e33f8585e440d5a630f6a63e947850'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.575838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e33f8585e440d5a630f6a63e947850'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.576534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e33f8585e440d5a630f6a63e947850'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.577174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e33f8585e440d5a630f6a63e947850'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.586364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ca1ef619-98a4-43d3-b8fb-62136dd8643d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:44.587594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ca1ef619-98a4-43d3-b8fb-62136dd8643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:44.591233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1264/2553] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:44 2022] DELETE /identity/v3/users/73e33f8585e440d5a630f6a63e947850 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:44.655876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1290/2554] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:44.660329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.673095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aae5ef-8197-4c9f-b59b-3fcad15ca4e4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.677989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.678596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.678899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.679185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.679884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:44.680185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.682010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.692317 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:44.702154 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1265/2555] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:18:44.703098 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ef619-98a4-43d3-b8fb-62136dd8643d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.712421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ef619-98a4-43d3-b8fb-62136dd8643d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.718895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.719325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.719635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.719932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.720583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.722513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.754450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1291/2556] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:44 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:44.758672 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.770942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181038c-9b6c-49f0-8916-b6ba3f5b5409 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.851051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.851781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.852132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.852474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.853173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.855772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.888204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.890429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:44.899916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1266/2557] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:44 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:44.904703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.906009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06a7e7-d158-457b-9623-fd0c4036ded7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.914069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.914806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09be4f-b54c-4a1b-bfb8-54452fe4ac37 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.915676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.916082 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.916366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] PATH_INFO: `/v3/projects/0ace74c9439f4cbb86aab33a1981622f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.917706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ace74c9439f4cbb86aab33a1981622f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.920367 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.920630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.920976 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.921397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.921677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.922518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.924562 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.940536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1267/2558] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:44.941303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.952627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aba629-dc4b-44f2-9757-02e7e4f4c586 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.957519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:44.958120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:44.958395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:44.958666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:44.959310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:44.960948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:44.972149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1268/2559] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:44.974043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:44.976227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:44.979186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ace74c9439f4cbb86aab33a1981622f', 'request_id': 'req-b64fb6e7-684c-4802-a016-37186a80ee3b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.988195 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ace74c9439f4cbb86aab33a1981622f', 'request_id': 'req-b64fb6e7-684c-4802-a016-37186a80ee3b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:44.988396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c8302-75b6-4fcd-93bb-9d43ca20a99a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:44.995759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ace74c9439f4cbb86aab33a1981622f', 'request_id': 'req-b64fb6e7-684c-4802-a016-37186a80ee3b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:45.014496 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] The token cache is being invalidate because project 0ace74c9439f4cbb86aab33a1981622f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:45.014964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:45.015714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b64fb6e7-684c-4802-a016-37186a80ee3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:45.018049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1292/2560] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:44 2022] DELETE /identity/v3/projects/0ace74c9439f4cbb86aab33a1981622f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:45.022539 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8fa04-cba8-4c91-8ee1-879b731de0c5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.023105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8fa04-cba8-4c91-8ee1-879b731de0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.023477 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8fa04-cba8-4c91-8ee1-879b731de0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.045555 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4af8fa04-cba8-4c91-8ee1-879b731de0c5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:45.046768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4af8fa04-cba8-4c91-8ee1-879b731de0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:45.059020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d209-c428-4823-815f-8fc2fe427f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.060325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d209-c428-4823-815f-8fc2fe427f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.060605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d209-c428-4823-815f-8fc2fe427f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.060889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d209-c428-4823-815f-8fc2fe427f31 admin admin] PATH_INFO: `/v3/projects/dd3daa6f882e4d00baeaaefd5e2bac92/users/1211693f95f345c4adfe18578a8c5dd5/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.076979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162d209-c428-4823-815f-8fc2fe427f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3daa6f882e4d00baeaaefd5e2bac92, user_id=1211693f95f345c4adfe18578a8c5dd5, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.079680 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162d209-c428-4823-815f-8fc2fe427f31 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.108858 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1269/2561] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:44 2022] PUT /identity/v3/projects/dd3daa6f882e4d00baeaaefd5e2bac92/users/1211693f95f345c4adfe18578a8c5dd5/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:45.120524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.124151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.124151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.127101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1293/2562] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:45.134796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c39ab-ef52-4f7f-b87e-37bb4b8bba6c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.135069 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c39ab-ef52-4f7f-b87e-37bb4b8bba6c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.135341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c39ab-ef52-4f7f-b87e-37bb4b8bba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.154723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] MFA Rules not processed for user `1211693f95f345c4adfe18578a8c5dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:45.157599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:45.158976 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-461c39ab-ef52-4f7f-b87e-37bb4b8bba6c None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:45.160230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-461c39ab-ef52-4f7f-b87e-37bb4b8bba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:45.210624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:45.234174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1294/2563] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:45.237867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c39ab-ef52-4f7f-b87e-37bb4b8bba6c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.242754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1270/2564] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:45.247963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.248939 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c39ab-ef52-4f7f-b87e-37bb4b8bba6c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.249538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:45.254530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.255366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.255780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.256714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.256903 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:45.257311 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.259182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.264184 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f071b7-bdf4-45c8-afdb-c791c1558c65 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.268819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.269422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.269697 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.269965 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.270586 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.272531 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.276799 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1295/2565] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:18:45.277936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.294505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302fb68-ebb2-4a86-a024-fac0410cc680 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.301769 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.303000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.303382 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.303784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.304948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.307948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.315751 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1271/2566] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:45.317032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.340443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1296/2567] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:45.344182 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.388429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:45.391529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0d8ee-fab3-437b-82f9-615df113ad33 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.416129 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9115ecb-824b-410b-8ccc-6108ecfdb28a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.421535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.422148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.422431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.422702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.423322 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.425273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.449246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1297/2568] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:45.453418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.458393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.459004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.459281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.459582 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.460199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.462110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.463085 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736a688-fd2b-4082-85f2-7861e6d287c8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.467773 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.468365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.468645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.468917 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.469584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.471163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.482498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1298/2569] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:18:45.486553 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.486938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1272/2570] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:45.487703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.497406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c142-2726-4c73-8bb9-12acf09e4f59 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.498212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf33e2-cd50-4fc8-ae43-56816d27d76c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.502036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.502630 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.502812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.502935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.503165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.503402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.503708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.503951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.504073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.504600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.505526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.506174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.516868 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1299/2571] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:18:45.517050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1273/2572] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:45.520584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.520825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.530628 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b33f-f7cb-458f-965d-311128c80b25 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.530805 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7b553-7765-4ad5-b25d-5ab57652a009 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.535175 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bed77-486c-457d-a79b-e2e19f0a19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.535387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.535845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bed77-486c-457d-a79b-e2e19f0a19c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.536126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bed77-486c-457d-a79b-e2e19f0a19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.536296 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.536420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bed77-486c-457d-a79b-e2e19f0a19c6 admin admin] PATH_INFO: `/v3/projects/43dfa7cf9df54cc1b995a1052707ba38/users/6937e71f3f2a41f89f6d6be4faa907ae/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.536576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.536851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] PATH_INFO: `/v3/projects/cfff7a2ae9ef4ff28a3a17f47e934498/users/c8651d2055024153b7bb3017791ac828/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.551937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bed77-486c-457d-a79b-e2e19f0a19c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dfa7cf9df54cc1b995a1052707ba38, user_id=6937e71f3f2a41f89f6d6be4faa907ae, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.552140 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfff7a2ae9ef4ff28a3a17f47e934498, user_id=c8651d2055024153b7bb3017791ac828, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.554826 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.554985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bed77-486c-457d-a79b-e2e19f0a19c6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.568525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1300/2573] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:45 2022] PUT /identity/v3/projects/cfff7a2ae9ef4ff28a3a17f47e934498/users/c8651d2055024153b7bb3017791ac828/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:45.569587 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1274/2574] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:45 2022] PUT /identity/v3/projects/43dfa7cf9df54cc1b995a1052707ba38/users/6937e71f3f2a41f89f6d6be4faa907ae/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:45.573427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.579077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00940b4-a121-47e2-8c46-f19ccccc76e0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.579362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00940b4-a121-47e2-8c46-f19ccccc76e0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.580219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00940b4-a121-47e2-8c46-f19ccccc76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.608494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e00940b4-a121-47e2-8c46-f19ccccc76e0 None None] MFA Rules not processed for user `c8651d2055024153b7bb3017791ac828`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:45.610107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e00940b4-a121-47e2-8c46-f19ccccc76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:45.618055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:45.641608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108017b-225c-4e1d-a3b1-30d05b0e3e6e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.680272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1275/2575] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:45.685755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00940b4-a121-47e2-8c46-f19ccccc76e0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.701849 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.702454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.702752 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.703018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.703702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.705297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.715277 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1301/2576] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:45.719295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.729156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcefec-5300-4dfb-a8a0-fffd5459debd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.734448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15defe93-42f6-4e3d-9f21-db8665759bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.735090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defe93-42f6-4e3d-9f21-db8665759bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.735372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defe93-42f6-4e3d-9f21-db8665759bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.735677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15defe93-42f6-4e3d-9f21-db8665759bf5 admin admin] PATH_INFO: `/v3/projects/43dfa7cf9df54cc1b995a1052707ba38/users/6937e71f3f2a41f89f6d6be4faa907ae/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.737581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15defe93-42f6-4e3d-9f21-db8665759bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dfa7cf9df54cc1b995a1052707ba38, user_id=6937e71f3f2a41f89f6d6be4faa907ae, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.740247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15defe93-42f6-4e3d-9f21-db8665759bf5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.750994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1302/2577] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:45 2022] PUT /identity/v3/projects/43dfa7cf9df54cc1b995a1052707ba38/users/6937e71f3f2a41f89f6d6be4faa907ae/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:45.752637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00940b4-a121-47e2-8c46-f19ccccc76e0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.761344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.761667 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.761935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.782993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:45.792216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] MFA Rules not processed for user `6937e71f3f2a41f89f6d6be4faa907ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:45.794567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:45.811272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.811938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.812220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.812482 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.813100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.815278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.845077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1276/2578] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:45.846024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.865035 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1303/2579] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:45.876120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.877526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:45.891601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:45.913803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d58c7-8c8c-4b92-88cb-5d6f2226800e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.919187 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.919830 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.920111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.920390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.921020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.922995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.939250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4923cc7-d667-4507-abac-85c4ae3348ec None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.950022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1277/2580] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:45 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:45.954177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.967555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b45a-ddf2-46ad-964f-77f14c79bbd0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:45.973543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.974549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.974886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.975180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:45.975971 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:45.977638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:45.989228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1278/2581] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:45.993401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:45.997421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:45.998034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:45.998312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:45.998586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.003436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc6c2-9511-417c-80b5-2c4a4e42d169 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:46.008292 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:46.008950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.009230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.009505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] PATH_INFO: `/v3/projects/1591a3eac5c948b58eec3271a398b6fb/users/2c0abe0c08394fe5ba224bf598ceb445/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.026193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1591a3eac5c948b58eec3271a398b6fb, user_id=2c0abe0c08394fe5ba224bf598ceb445, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.030446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.048127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1279/2582] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:45 2022] PUT /identity/v3/projects/1591a3eac5c948b58eec3271a398b6fb/users/2c0abe0c08394fe5ba224bf598ceb445/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:46.052601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:46.071824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.073964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.083745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1304/2583] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:18:46.123344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3f5a-dde2-4bc2-8cba-f8de24181f7d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:46.128183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:46.128973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.129349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.129722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.130524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.132270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.144549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1280/2584] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:18:46.148859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:46.160815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:46.165408 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:46.167105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f11d-110a-4d9c-8c1f-03ccec5ba10b service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:46.172721 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4640c-3133-4aef-bfb5-07b9cc4107f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:46.173377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4640c-3133-4aef-bfb5-07b9cc4107f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.173653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4640c-3133-4aef-bfb5-07b9cc4107f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.173921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4640c-3133-4aef-bfb5-07b9cc4107f3 admin admin] PATH_INFO: `/v3/projects/1591a3eac5c948b58eec3271a398b6fb/users/2c0abe0c08394fe5ba224bf598ceb445/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.175839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4640c-3133-4aef-bfb5-07b9cc4107f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1591a3eac5c948b58eec3271a398b6fb, user_id=2c0abe0c08394fe5ba224bf598ceb445, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.178452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4640c-3133-4aef-bfb5-07b9cc4107f3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.190362 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1305/2585] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:46 2022] PUT /identity/v3/projects/1591a3eac5c948b58eec3271a398b6fb/users/2c0abe0c08394fe5ba224bf598ceb445/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:46.201687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.201983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.202247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.223086 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c719dc-31e6-4c4a-8f25-27b1ebefdfaf admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:46.229865 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] MFA Rules not processed for user `2c0abe0c08394fe5ba224bf598ceb445`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:46.232024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:46.267197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:46.272664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:46.273378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.274005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.275849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.315815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1306/2586] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:46.326120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:46.327587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:46.340014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ad57-6d66-4707-a933-03d63b9fa43b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:46.343683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:46.344285 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.344560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.344832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.346114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.347614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.354151 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.356348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.357347 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1281/2587] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:46.368303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1307/2588] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:18:46.443717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:46.452700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6877-9af6-4f31-9df9-d55a447e14a1 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:46.456683 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f213ae-9847-47c3-8a92-9f332c2e9172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:46.457281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f213ae-9847-47c3-8a92-9f332c2e9172 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.457567 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f213ae-9847-47c3-8a92-9f332c2e9172 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.457823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f213ae-9847-47c3-8a92-9f332c2e9172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.530662 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f213ae-9847-47c3-8a92-9f332c2e9172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.532149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f213ae-9847-47c3-8a92-9f332c2e9172 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.540937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1282/2589] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:46.808828 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:46.868585 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b04d-0275-40bf-aae7-6bae916d21ae service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:46.873022 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:46.873639 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.873911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.874180 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] PATH_INFO: `/v3/users/c8651d2055024153b7bb3017791ac828` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.875274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8651d2055024153b7bb3017791ac828)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:46.877200 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:46.921944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8651d2055024153b7bb3017791ac828'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:46.922594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8651d2055024153b7bb3017791ac828'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:46.933261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:46.934734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8651d2055024153b7bb3017791ac828'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:46.935692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8651d2055024153b7bb3017791ac828'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:46.944674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8651d2055024153b7bb3017791ac828'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:46.957544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1308/2590] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:46 2022] DELETE /identity/v3/users/c8651d2055024153b7bb3017791ac828 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:46.962393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:46.962678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:46.962948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:46.981939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:46.983125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:47.041108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1283/2591] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:47.051044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:47.052504 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:47.110007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a2a9e-294c-401b-8860-2f02ad3ee7be admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:47.113648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:47.114245 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:47.114516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:47.114779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:47.123974 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:47.124854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:47.134079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1309/2592] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:47.408016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:47.409538 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:47.421420 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0837f-4851-41f4-b8b5-de18aabd988b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:47.426021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:47.426660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:47.426926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:47.427197 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] PATH_INFO: `/v3/projects/cfff7a2ae9ef4ff28a3a17f47e934498` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:47.428479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfff7a2ae9ef4ff28a3a17f47e934498)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:47.430261 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:47.469664 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:47.479759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfff7a2ae9ef4ff28a3a17f47e934498', 'request_id': 'req-2d3b3ed4-5567-4f8e-bede-27650384ad90'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.486942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfff7a2ae9ef4ff28a3a17f47e934498', 'request_id': 'req-2d3b3ed4-5567-4f8e-bede-27650384ad90'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.492369 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfff7a2ae9ef4ff28a3a17f47e934498', 'request_id': 'req-2d3b3ed4-5567-4f8e-bede-27650384ad90'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.503611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] The token cache is being invalidate because project cfff7a2ae9ef4ff28a3a17f47e934498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:47.503901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.504558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.506056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1284/2593] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:47 2022] DELETE /identity/v3/projects/cfff7a2ae9ef4ff28a3a17f47e934498 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:47.510197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:47.521273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906a29f-28f2-49a9-9b0b-33e7efc36512 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:47.580326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:47.581071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:47.581349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:47.581616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] PATH_INFO: `/v3/users/2c0abe0c08394fe5ba224bf598ceb445` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:47.582774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0abe0c08394fe5ba224bf598ceb445)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:47.584704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:47.645086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0abe0c08394fe5ba224bf598ceb445'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.645754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0abe0c08394fe5ba224bf598ceb445'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.658812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0abe0c08394fe5ba224bf598ceb445'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.659405 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0abe0c08394fe5ba224bf598ceb445'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.666505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d1ed6be-9698-430b-b2f5-68ae89d26388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0abe0c08394fe5ba224bf598ceb445'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:47.679658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1310/2594] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:47 2022] DELETE /identity/v3/users/2c0abe0c08394fe5ba224bf598ceb445 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:47.997275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:47.998703 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:48.015650 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3ed4-5567-4f8e-bede-27650384ad90 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.072021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.072647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.072920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.073186 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] PATH_INFO: `/v3/projects/1591a3eac5c948b58eec3271a398b6fb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.074897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1591a3eac5c948b58eec3271a398b6fb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.076828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.122177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1591a3eac5c948b58eec3271a398b6fb', 'request_id': 'req-8d2d0f57-c461-4600-a6aa-b31c45540a84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.129300 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1591a3eac5c948b58eec3271a398b6fb', 'request_id': 'req-8d2d0f57-c461-4600-a6aa-b31c45540a84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.135648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1591a3eac5c948b58eec3271a398b6fb', 'request_id': 'req-8d2d0f57-c461-4600-a6aa-b31c45540a84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.147214 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] The token cache is being invalidate because project 1591a3eac5c948b58eec3271a398b6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:48.147527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.148170 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8d2d0f57-c461-4600-a6aa-b31c45540a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.149647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1285/2595] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:47 2022] DELETE /identity/v3/projects/1591a3eac5c948b58eec3271a398b6fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:48.154755 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba84d8-4c4c-45f2-9f52-52d451004663 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.155033 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba84d8-4c4c-45f2-9f52-52d451004663 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.155303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba84d8-4c4c-45f2-9f52-52d451004663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.162879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:48.177761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a6ba84d8-4c4c-45f2-9f52-52d451004663 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:48.179011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a6ba84d8-4c4c-45f2-9f52-52d451004663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:48.237738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1311/2596] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:48.245384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422844c5-7dea-4247-a4fe-8dd3a124dc7d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.246256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422844c5-7dea-4247-a4fe-8dd3a124dc7d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.246559 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422844c5-7dea-4247-a4fe-8dd3a124dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.266413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-422844c5-7dea-4247-a4fe-8dd3a124dc7d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:48.267627 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-422844c5-7dea-4247-a4fe-8dd3a124dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:48.276406 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1286/2597] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:48.280824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba84d8-4c4c-45f2-9f52-52d451004663 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.290266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba84d8-4c4c-45f2-9f52-52d451004663 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.295211 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.295839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.296112 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.296380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.297013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:48.297308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.298911 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.311797 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1312/2598] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:18:48.316620 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422844c5-7dea-4247-a4fe-8dd3a124dc7d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.327260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422844c5-7dea-4247-a4fe-8dd3a124dc7d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.332077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.332678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.332977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.333244 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.333869 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.335792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.362373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1287/2599] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:48 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:48.366329 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.376807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0537344-f045-451c-a95d-057839921bd2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.431307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.431855 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.432126 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.432390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.432989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.435514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.455926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1313/2600] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:48 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:48.460032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.470592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cb1f6-52c5-4e9b-a6c1-600f1cd12c32 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.475148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.475794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.476071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.476339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.476973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.478551 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.488912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1288/2601] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:48.492772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.503210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f048f3-d265-49c4-82bd-1483447d22ef admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.507836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761eda4-b419-49cc-9161-b67a2ddc0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.508418 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761eda4-b419-49cc-9161-b67a2ddc0c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.508690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761eda4-b419-49cc-9161-b67a2ddc0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.508957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761eda4-b419-49cc-9161-b67a2ddc0c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.509582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761eda4-b419-49cc-9161-b67a2ddc0c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.511177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761eda4-b419-49cc-9161-b67a2ddc0c9a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.521931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1314/2602] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:48.525987 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.536106 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6137bd-4fda-4aa5-a81c-8d6cc6466356 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.540780 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.541413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.541690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.541963 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] PATH_INFO: `/v3/projects/0701a36bec8b42afb0b5af43b3cee036/users/71a4b32c9af842198efeebf8909c6564/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.554644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:48.563613 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701a36bec8b42afb0b5af43b3cee036, user_id=71a4b32c9af842198efeebf8909c6564, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.567259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.580174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1289/2603] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:48 2022] PUT /identity/v3/projects/0701a36bec8b42afb0b5af43b3cee036/users/71a4b32c9af842198efeebf8909c6564/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:48.647031 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c8c3-5f12-4815-b51a-38f7d5869e01 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.647306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c8c3-5f12-4815-b51a-38f7d5869e01 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.647607 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c8c3-5f12-4815-b51a-38f7d5869e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.675093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e438c8c3-5f12-4815-b51a-38f7d5869e01 None None] MFA Rules not processed for user `71a4b32c9af842198efeebf8909c6564`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:48.676325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e438c8c3-5f12-4815-b51a-38f7d5869e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:48.734430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:48.740240 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1315/2604] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:48.752283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.753942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:48.808928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f7b43-9a5b-4026-a9bc-d0a2d755056a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.812523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e1ba-0579-4dd4-9eaa-8deed17a3816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.813354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e1ba-0579-4dd4-9eaa-8deed17a3816 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.813634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e1ba-0579-4dd4-9eaa-8deed17a3816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.813923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e1ba-0579-4dd4-9eaa-8deed17a3816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.821908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e1ba-0579-4dd4-9eaa-8deed17a3816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.823326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e1ba-0579-4dd4-9eaa-8deed17a3816 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.832132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1290/2605] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:48.851398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438c8c3-5f12-4815-b51a-38f7d5869e01 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:48.913325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438c8c3-5f12-4815-b51a-38f7d5869e01 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:48.918601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:48.919225 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:48.919528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:48.919795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] PATH_INFO: `/v3/users/71a4b32c9af842198efeebf8909c6564` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:48.920942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a4b32c9af842198efeebf8909c6564)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:48.922852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:48.969703 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a4b32c9af842198efeebf8909c6564'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.970370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a4b32c9af842198efeebf8909c6564'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.982808 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a4b32c9af842198efeebf8909c6564'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.983475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a4b32c9af842198efeebf8909c6564'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:48.990453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a4b32c9af842198efeebf8909c6564'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:49.003307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1316/2606] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:48 2022] DELETE /identity/v3/users/71a4b32c9af842198efeebf8909c6564 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:49.008225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.008512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.008807 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.029690 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:49.030894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:49.093833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1291/2607] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:49.104467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.106790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:49.170501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb92a5c-92c4-45cc-8fa4-0f8e07d57ffc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.174335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ab91-dc2b-499c-a192-474ab2457e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.174878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ab91-dc2b-499c-a192-474ab2457e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.175203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ab91-dc2b-499c-a192-474ab2457e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.175436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ab91-dc2b-499c-a192-474ab2457e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.184819 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ab91-dc2b-499c-a192-474ab2457e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:49.186272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ab91-dc2b-499c-a192-474ab2457e1a service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:49.196279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1317/2608] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:18:49.489095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.490990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:49.502742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b638-9c02-4680-b182-e04b7df2540a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.508269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.508966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.509249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.509702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] PATH_INFO: `/v3/projects/0701a36bec8b42afb0b5af43b3cee036` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.510880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0701a36bec8b42afb0b5af43b3cee036)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:49.513713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:49.566275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0701a36bec8b42afb0b5af43b3cee036', 'request_id': 'req-2641f274-2f27-4cdc-9722-185c12db4450'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:49.577524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0701a36bec8b42afb0b5af43b3cee036', 'request_id': 'req-2641f274-2f27-4cdc-9722-185c12db4450'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:49.583994 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0701a36bec8b42afb0b5af43b3cee036', 'request_id': 'req-2641f274-2f27-4cdc-9722-185c12db4450'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:49.595903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] The token cache is being invalidate because project 0701a36bec8b42afb0b5af43b3cee036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:49.596253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:49.596962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2641f274-2f27-4cdc-9722-185c12db4450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:49.598505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1292/2609] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:49 2022] DELETE /identity/v3/projects/0701a36bec8b42afb0b5af43b3cee036 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:49.603869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574da23-fe86-48ad-9b3f-3049bb7308ed None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.604372 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574da23-fe86-48ad-9b3f-3049bb7308ed None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.604690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574da23-fe86-48ad-9b3f-3049bb7308ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.625086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b574da23-fe86-48ad-9b3f-3049bb7308ed None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:49.626280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b574da23-fe86-48ad-9b3f-3049bb7308ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:49.640102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:49.687246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1318/2610] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:49.695136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0f613-78aa-4f2e-9cb0-ea5b567ad3dd None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.695519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0f613-78aa-4f2e-9cb0-ea5b567ad3dd None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.695739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0f613-78aa-4f2e-9cb0-ea5b567ad3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.715937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d3e0f613-78aa-4f2e-9cb0-ea5b567ad3dd None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:49.717135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d3e0f613-78aa-4f2e-9cb0-ea5b567ad3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:49.724967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1293/2611] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:49.729041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574da23-fe86-48ad-9b3f-3049bb7308ed None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.738602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574da23-fe86-48ad-9b3f-3049bb7308ed None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.743115 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.743678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.743957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.744222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.744859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:49.745154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:49.747377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:49.758535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1319/2612] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:18:49.763564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0f613-78aa-4f2e-9cb0-ea5b567ad3dd None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.772635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0f613-78aa-4f2e-9cb0-ea5b567ad3dd None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.777340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.777924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.778199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.778464 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.779081 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:49.781041 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:49.790243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:49.810344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1294/2613] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:49 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:49.814114 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.824467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885890-b4a2-4ffe-8fc0-f2e4d22ef6fe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.880451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.881055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.881358 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.881628 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.882233 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:49.884189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:49.905878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1320/2614] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:49 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:49.910141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.921084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6a547-5049-42de-a811-7b6c44d018df admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.925910 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.926510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.926784 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.927052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.927724 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:49.929309 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:49.939921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1295/2615] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:49.943765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.954184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b869d-5d0c-4885-8c16-20e2e3a1cbe7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.958759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ca32c-0fb0-462b-99d3-894c776e6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.959342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca32c-0fb0-462b-99d3-894c776e6dba admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.959662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca32c-0fb0-462b-99d3-894c776e6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.959933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca32c-0fb0-462b-99d3-894c776e6dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:49.960644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ca32c-0fb0-462b-99d3-894c776e6dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:49.962333 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ca32c-0fb0-462b-99d3-894c776e6dba admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:49.973377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1321/2616] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:49.977605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:49.988764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbccfa6-5d20-45bd-a91d-09f2f10273f8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:49.993399 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:49.993982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:49.994260 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:49.994530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] PATH_INFO: `/v3/projects/f01d7d21f31748d3a08769d261dcb142/users/e96b820460d9447897ddec4765046f9d/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:50.009889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01d7d21f31748d3a08769d261dcb142, user_id=e96b820460d9447897ddec4765046f9d, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:50.012779 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:50.025268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1296/2617] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:49 2022] PUT /identity/v3/projects/f01d7d21f31748d3a08769d261dcb142/users/e96b820460d9447897ddec4765046f9d/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:50.035662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4074-8f1e-4256-b64e-69955abc02b9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:50.035949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4074-8f1e-4256-b64e-69955abc02b9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:50.036224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4074-8f1e-4256-b64e-69955abc02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:50.064818 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d88f4074-8f1e-4256-b64e-69955abc02b9 None None] MFA Rules not processed for user `e96b820460d9447897ddec4765046f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:50.066011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d88f4074-8f1e-4256-b64e-69955abc02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:50.130386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1322/2618] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:50.141502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:50.143196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:50.199388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3461-26a7-425f-ad36-b25d02a37081 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:50.202970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cf514-c193-4e3a-a2ca-5d322f559869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:50.203595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cf514-c193-4e3a-a2ca-5d322f559869 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:50.203878 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cf514-c193-4e3a-a2ca-5d322f559869 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:50.204148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cf514-c193-4e3a-a2ca-5d322f559869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:50.212340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cf514-c193-4e3a-a2ca-5d322f559869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:50.213787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cf514-c193-4e3a-a2ca-5d322f559869 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:50.222444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1297/2619] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:55.349408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4074-8f1e-4256-b64e-69955abc02b9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:55.367217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:55.416904 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4074-8f1e-4256-b64e-69955abc02b9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:55.421744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:55.422447 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:55.422730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:55.423000 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] PATH_INFO: `/v3/users/e96b820460d9447897ddec4765046f9d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:55.424214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96b820460d9447897ddec4765046f9d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:55.426111 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:55.478459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96b820460d9447897ddec4765046f9d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:55.479226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96b820460d9447897ddec4765046f9d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:55.492627 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96b820460d9447897ddec4765046f9d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:55.493373 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96b820460d9447897ddec4765046f9d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:55.505304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96b820460d9447897ddec4765046f9d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:55.518965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1323/2620] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:55 2022] DELETE /identity/v3/users/e96b820460d9447897ddec4765046f9d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:55.523849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:55.524325 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:55.524561 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:55.544856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:55.545936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:55.605795 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1298/2621] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:55.615672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:55.617130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:55.696822 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd97fa-2139-4ee6-b185-589f68c9c990 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:55.700729 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c6ee8-4d7a-44c8-aef8-3b18da126f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:55.701335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6ee8-4d7a-44c8-aef8-3b18da126f89 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:55.701612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6ee8-4d7a-44c8-aef8-3b18da126f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:55.701883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6ee8-4d7a-44c8-aef8-3b18da126f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:55.711589 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c6ee8-4d7a-44c8-aef8-3b18da126f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:55.713034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c6ee8-4d7a-44c8-aef8-3b18da126f89 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:55.722763 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1324/2622] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:56.000510 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.001978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:56.015787 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7c030-8906-4b2e-8d2c-f3db5af2ed31 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.020981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.021723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.022005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.022278 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] PATH_INFO: `/v3/projects/f01d7d21f31748d3a08769d261dcb142` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.023492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01d7d21f31748d3a08769d261dcb142)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.025391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.072893 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01d7d21f31748d3a08769d261dcb142', 'request_id': 'req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.075404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:56.080864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01d7d21f31748d3a08769d261dcb142', 'request_id': 'req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.087437 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01d7d21f31748d3a08769d261dcb142', 'request_id': 'req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.099631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] The token cache is being invalidate because project f01d7d21f31748d3a08769d261dcb142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:56.099938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.100670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ef3c4e60-818a-42a3-8d52-03d5d39acdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.102533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1299/2623] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:55 2022] DELETE /identity/v3/projects/f01d7d21f31748d3a08769d261dcb142 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:56.108466 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88940a-6c91-400a-a0a2-b99f028a4082 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.108758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88940a-6c91-400a-a0a2-b99f028a4082 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.109036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88940a-6c91-400a-a0a2-b99f028a4082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.128037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4a88940a-6c91-400a-a0a2-b99f028a4082 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:56.129247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4a88940a-6c91-400a-a0a2-b99f028a4082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:56.141273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:56.189996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1325/2624] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:56.199048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade1e0-9877-4e83-a4e8-dc07f146cd95 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.199455 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade1e0-9877-4e83-a4e8-dc07f146cd95 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.199742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade1e0-9877-4e83-a4e8-dc07f146cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.219905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ebade1e0-9877-4e83-a4e8-dc07f146cd95 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:56.221112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ebade1e0-9877-4e83-a4e8-dc07f146cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:56.229107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1300/2625] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:56.233795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88940a-6c91-400a-a0a2-b99f028a4082 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.243379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88940a-6c91-400a-a0a2-b99f028a4082 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.248331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.248949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.249229 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.249495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.250134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:56.250432 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.252042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.264034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1326/2626] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:18:56.268132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade1e0-9877-4e83-a4e8-dc07f146cd95 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.278051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade1e0-9877-4e83-a4e8-dc07f146cd95 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.282833 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.283433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.283726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.283997 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.284619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.286517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.315131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1301/2627] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:56 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:56.319320 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.330366 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532cf5-83c4-4492-a24e-f6ab5f28fd37 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.389023 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.389744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.389888 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.390156 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.390760 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.392674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.414591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1327/2628] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:56 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:56.418906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.429044 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710d240-b20f-4f73-a2d6-29e66f1daf69 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.433763 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.434357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.434632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.434923 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.435591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.437198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.447107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1302/2629] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:56.451460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.461053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ccbd6-8382-4431-abd3-2dd616be0949 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.466149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063804-3f29-4fdf-a48c-5848e1c403cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.466740 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063804-3f29-4fdf-a48c-5848e1c403cd admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.466994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063804-3f29-4fdf-a48c-5848e1c403cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.467258 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063804-3f29-4fdf-a48c-5848e1c403cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.467954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24063804-3f29-4fdf-a48c-5848e1c403cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.469702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24063804-3f29-4fdf-a48c-5848e1c403cd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.480100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1328/2630] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:56.484591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.494390 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d4f5a-6788-4f74-b6b5-64d847243a15 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.499512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.500157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.500435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.500707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] PATH_INFO: `/v3/projects/9d3731760c0148949dc2d01c43295891/users/a8b7c04866c54691ba73645e141023c4/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.516005 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3731760c0148949dc2d01c43295891, user_id=a8b7c04866c54691ba73645e141023c4, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.518666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.532596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1303/2631] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:56 2022] PUT /identity/v3/projects/9d3731760c0148949dc2d01c43295891/users/a8b7c04866c54691ba73645e141023c4/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:56.543186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.543485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.543758 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.572133 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] MFA Rules not processed for user `a8b7c04866c54691ba73645e141023c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:56.573380 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:56.641514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1329/2632] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:18:56.653981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.656478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:56.724924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb11-8586-487a-97aa-33986319fb23 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.728661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677072f4-0ae8-4523-a03b-acfe70b4d174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.729307 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677072f4-0ae8-4523-a03b-acfe70b4d174 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.729570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677072f4-0ae8-4523-a03b-acfe70b4d174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.729928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677072f4-0ae8-4523-a03b-acfe70b4d174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.739881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677072f4-0ae8-4523-a03b-acfe70b4d174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.741315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677072f4-0ae8-4523-a03b-acfe70b4d174 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.751259 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1304/2633] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:56.753440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:56.754843 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:56.769854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:56.821535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e1e88-28b3-4746-9a67-04869c6f238b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:56.827149 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:56.827815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.828092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.828365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] PATH_INFO: `/v3/users/1211693f95f345c4adfe18578a8c5dd5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.829502 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1211693f95f345c4adfe18578a8c5dd5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:56.831421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:56.878694 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1211693f95f345c4adfe18578a8c5dd5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.879486 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1211693f95f345c4adfe18578a8c5dd5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.892534 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1211693f95f345c4adfe18578a8c5dd5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.893223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1211693f95f345c4adfe18578a8c5dd5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.900053 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1211693f95f345c4adfe18578a8c5dd5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:56.913733 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1330/2634] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:56 2022] DELETE /identity/v3/users/1211693f95f345c4adfe18578a8c5dd5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:56.922512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:56.923075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:56.923355 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:56.942954 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:56.944173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:57.007615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1305/2635] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:57.020095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:57.021753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:57.092823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454a28-d7c0-4194-b04b-49baac3993e5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:57.096847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:57.097463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:57.097927 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:57.098220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:57.109532 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:57.110940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:57.120146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1331/2636] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:57.405084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:57.406527 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:57.419809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1412a-cde8-4115-8e7e-d49ed94f6ccc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:57.424575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:57.425444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:57.425597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:57.425754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] PATH_INFO: `/v3/projects/dd3daa6f882e4d00baeaaefd5e2bac92` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:57.426880 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3daa6f882e4d00baeaaefd5e2bac92)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:57.428862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:57.446036 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:57.477762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3daa6f882e4d00baeaaefd5e2bac92', 'request_id': 'req-6d19218b-46ac-4643-9346-8784c61259db'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.485643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3daa6f882e4d00baeaaefd5e2bac92', 'request_id': 'req-6d19218b-46ac-4643-9346-8784c61259db'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.491146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3daa6f882e4d00baeaaefd5e2bac92', 'request_id': 'req-6d19218b-46ac-4643-9346-8784c61259db'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.501839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] The token cache is being invalidate because project dd3daa6f882e4d00baeaaefd5e2bac92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:57.502123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.502798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.504237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1306/2637] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:57 2022] DELETE /identity/v3/projects/dd3daa6f882e4d00baeaaefd5e2bac92 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:57.508378 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:57.518494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7b0eb-2352-44fe-a089-6f180a91306e service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:57.551401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:57.578153 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:57.578779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:57.579061 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:57.579339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] PATH_INFO: `/v3/users/6937e71f3f2a41f89f6d6be4faa907ae` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:57.580493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6937e71f3f2a41f89f6d6be4faa907ae)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:57.582397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:57.629001 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6937e71f3f2a41f89f6d6be4faa907ae'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.629637 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6937e71f3f2a41f89f6d6be4faa907ae'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.641393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6937e71f3f2a41f89f6d6be4faa907ae'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.642006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6937e71f3f2a41f89f6d6be4faa907ae'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.648682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5e29232e-14b3-4bf0-a3a1-befcab48dbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6937e71f3f2a41f89f6d6be4faa907ae'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:57.661464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1332/2638] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:18:57 2022] DELETE /identity/v3/users/6937e71f3f2a41f89f6d6be4faa907ae => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:57.929109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:57.930573 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:57.948109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19218b-46ac-4643-9346-8784c61259db admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.010850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.011956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.012231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.012499 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] PATH_INFO: `/v3/projects/43dfa7cf9df54cc1b995a1052707ba38` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.013611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43dfa7cf9df54cc1b995a1052707ba38)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.015526 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.062859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43dfa7cf9df54cc1b995a1052707ba38', 'request_id': 'req-dbc48c14-049e-42e9-90f4-e1add5af6700'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:58.071728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43dfa7cf9df54cc1b995a1052707ba38', 'request_id': 'req-dbc48c14-049e-42e9-90f4-e1add5af6700'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:58.078091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43dfa7cf9df54cc1b995a1052707ba38', 'request_id': 'req-dbc48c14-049e-42e9-90f4-e1add5af6700'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:58.090042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] The token cache is being invalidate because project 43dfa7cf9df54cc1b995a1052707ba38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:18:58.090353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:58.091174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-dbc48c14-049e-42e9-90f4-e1add5af6700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:18:58.092756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1307/2639] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:18:57 2022] DELETE /identity/v3/projects/43dfa7cf9df54cc1b995a1052707ba38 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:58.097872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a592d-b397-432b-a516-43e335d4373d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.098236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a592d-b397-432b-a516-43e335d4373d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.098495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a592d-b397-432b-a516-43e335d4373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.119307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a30a592d-b397-432b-a516-43e335d4373d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:58.120604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a30a592d-b397-432b-a516-43e335d4373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:58.181208 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1333/2640] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:58.192208 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d264c2-135a-4f6c-8855-a48a10993a03 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.192490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d264c2-135a-4f6c-8855-a48a10993a03 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.192761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d264c2-135a-4f6c-8855-a48a10993a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.213696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a2d264c2-135a-4f6c-8855-a48a10993a03 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:58.214960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2d264c2-135a-4f6c-8855-a48a10993a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:58.223397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1308/2641] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:58.227768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a592d-b397-432b-a516-43e335d4373d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.237739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a592d-b397-432b-a516-43e335d4373d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.242430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.243025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.243298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.243601 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.244236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:18:58.244533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.246866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.259520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1334/2642] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:18:58.264674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d264c2-135a-4f6c-8855-a48a10993a03 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.274709 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d264c2-135a-4f6c-8855-a48a10993a03 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.282707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.283657 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.284180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.284458 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.285051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.287157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.319056 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1309/2643] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:58 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:58.323407 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.334428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3da22-c1d2-46e4-a417-346e080c3574 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.375164 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:58.393494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.394117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.394377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.394645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.395273 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.397223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.418739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1335/2644] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:58 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:58.422903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.429465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:58.433796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e47f8b-2caa-4dd7-87a8-02357b15dfdd admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.439862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.440617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.441132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.441457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.442264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.443897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.454080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1310/2645] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:58.458004 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.468456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23314b93-551a-4025-9f93-d8570d75ed34 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.473073 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492bf6f-df99-4d70-b88f-5201562aa6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.473658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492bf6f-df99-4d70-b88f-5201562aa6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.473933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492bf6f-df99-4d70-b88f-5201562aa6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.474199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492bf6f-df99-4d70-b88f-5201562aa6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.474827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492bf6f-df99-4d70-b88f-5201562aa6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.476441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492bf6f-df99-4d70-b88f-5201562aa6d1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.486887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1336/2646] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:18:58.490846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.500964 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a64f46-0c94-488f-9cab-1bb5a50732d2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.505530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.506169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.506444 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.506716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] PATH_INFO: `/v3/projects/8040ec3f74804e36af7f3d14b04f9903/users/4ff2bf88fbba4772b5e1717f9ece8b9f/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.521904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8040ec3f74804e36af7f3d14b04f9903, user_id=4ff2bf88fbba4772b5e1717f9ece8b9f, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.524565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.538132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1311/2647] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:58 2022] PUT /identity/v3/projects/8040ec3f74804e36af7f3d14b04f9903/users/4ff2bf88fbba4772b5e1717f9ece8b9f/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:58.548513 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c108-df9f-48e5-b967-adf2550f0f87 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.548978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c108-df9f-48e5-b967-adf2550f0f87 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.549077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c108-df9f-48e5-b967-adf2550f0f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.577318 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4420c108-df9f-48e5-b967-adf2550f0f87 None None] MFA Rules not processed for user `4ff2bf88fbba4772b5e1717f9ece8b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:58.578530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4420c108-df9f-48e5-b967-adf2550f0f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:58.643197 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1337/2648] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:58 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:58.647774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.708558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f5ed9-737c-445c-a50f-5b0a1c4a2d07 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.713243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.713840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.714173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.714974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.715734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.717639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.743644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1312/2649] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:18:58 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:18:58.747982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c108-df9f-48e5-b967-adf2550f0f87 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.758423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c108-df9f-48e5-b967-adf2550f0f87 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.813852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.814449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.814726 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.814988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.815634 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.817522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.838877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1338/2650] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:18:58 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:18:58.843548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.853955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a4aa-2d68-4c0a-8a8b-f14f0ba274d7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.859032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.859656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.859938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.860213 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.860851 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.862448 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.873088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1313/2651] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:58.877176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.887886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25367-d26d-4096-a732-01b7476e5f6a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.892455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.893093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.893375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.893644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] PATH_INFO: `/v3/projects/ab2f469577e64b9e9fd2548df4cc278f/users/ce221cb5d2e44912abc0813e8460b226/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.909093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2f469577e64b9e9fd2548df4cc278f, user_id=ce221cb5d2e44912abc0813e8460b226, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.912044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:58.924834 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1339/2652] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:58 2022] PUT /identity/v3/projects/ab2f469577e64b9e9fd2548df4cc278f/users/ce221cb5d2e44912abc0813e8460b226/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:18:58.928739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:58.939314 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e66e52-0bc7-45e6-b43e-206dc0cf2091 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:58.994032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710eb56-34a2-4cd0-9cab-7f3caa7d8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:58.994624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710eb56-34a2-4cd0-9cab-7f3caa7d8b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:58.994904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710eb56-34a2-4cd0-9cab-7f3caa7d8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:58.995172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710eb56-34a2-4cd0-9cab-7f3caa7d8b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:58.996394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710eb56-34a2-4cd0-9cab-7f3caa7d8b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:58.998048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710eb56-34a2-4cd0-9cab-7f3caa7d8b84 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:59.007430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1314/2653] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:18:59.012485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:59.022579 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be1612-a7da-482a-a682-98884714ce56 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:59.027573 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:59.028223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:59.028525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:59.028792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] PATH_INFO: `/v3/projects/ab2f469577e64b9e9fd2548df4cc278f/users/ce221cb5d2e44912abc0813e8460b226/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:59.030696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2f469577e64b9e9fd2548df4cc278f, user_id=ce221cb5d2e44912abc0813e8460b226, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:59.033385 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:59.043341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1340/2654] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:18:59 2022] PUT /identity/v3/projects/ab2f469577e64b9e9fd2548df4cc278f/users/ce221cb5d2e44912abc0813e8460b226/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:18:59.053280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7034-0c05-4dc8-8316-178eca76e256 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:59.053638 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7034-0c05-4dc8-8316-178eca76e256 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:59.054007 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7034-0c05-4dc8-8316-178eca76e256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:59.087392 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-106d7034-0c05-4dc8-8316-178eca76e256 None None] MFA Rules not processed for user `ce221cb5d2e44912abc0813e8460b226`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:18:59.088535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-106d7034-0c05-4dc8-8316-178eca76e256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:59.117334 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:59.158183 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1315/2655] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:18:59 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:18:59.169344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:59.171097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:18:59.176599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:18:59.231003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942b06-3871-44ee-b77a-c1af997b4ebd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:59.234770 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:59.235371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:59.235681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:59.235980 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:59.244804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:59.247175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:59.256515 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1341/2656] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:18:59.405349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7034-0c05-4dc8-8316-178eca76e256 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:18:59.415119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7034-0c05-4dc8-8316-178eca76e256 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:18:59.419313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490ca85-1d1e-4a78-9e24-6e6da5e21298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:18:59.419927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ca85-1d1e-4a78-9e24-6e6da5e21298 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:18:59.420199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ca85-1d1e-4a78-9e24-6e6da5e21298 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:18:59.420465 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ca85-1d1e-4a78-9e24-6e6da5e21298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:18:59.479644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490ca85-1d1e-4a78-9e24-6e6da5e21298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:18:59.481798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490ca85-1d1e-4a78-9e24-6e6da5e21298 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:18:59.490666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1316/2657] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:18:59 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:19:09.252304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=25 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:09.486585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=44 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:09.909406 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:09.974590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d258eb2-c2d5-4477-abe3-541b69431f13 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:09.979026 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:09.979670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:09.979945 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:09.980212 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] PATH_INFO: `/v3/users/4ff2bf88fbba4772b5e1717f9ece8b9f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:09.981455 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff2bf88fbba4772b5e1717f9ece8b9f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:09.983334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:10.027898 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff2bf88fbba4772b5e1717f9ece8b9f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.028535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff2bf88fbba4772b5e1717f9ece8b9f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.039878 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff2bf88fbba4772b5e1717f9ece8b9f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.040538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff2bf88fbba4772b5e1717f9ece8b9f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.047124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff2bf88fbba4772b5e1717f9ece8b9f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.060440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1342/2658] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:19:09 2022] DELETE /identity/v3/users/4ff2bf88fbba4772b5e1717f9ece8b9f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:19:10.065341 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:10.065618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:10.065926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:10.084948 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:10.086128 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:10.142943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1317/2659] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:10.152695 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:10.154088 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:10.209622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960eda-aaa5-4512-b361-d1b6d91dd4ca admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:10.213117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:10.213724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:10.213998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:10.214264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:10.223017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:10.224458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:10.234473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1343/2660] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:19:10.512270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:10.513754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:10.525871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041fb4-7015-4296-8e17-d7770f100153 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:10.531386 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:10.532121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:10.532461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:10.532798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] PATH_INFO: `/v3/projects/8040ec3f74804e36af7f3d14b04f9903` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:10.534625 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8040ec3f74804e36af7f3d14b04f9903)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:10.536610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:10.584512 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8040ec3f74804e36af7f3d14b04f9903', 'request_id': 'req-0bab4638-bf38-498b-9e9b-53398c0d42ed'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.592071 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8040ec3f74804e36af7f3d14b04f9903', 'request_id': 'req-0bab4638-bf38-498b-9e9b-53398c0d42ed'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.597863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8040ec3f74804e36af7f3d14b04f9903', 'request_id': 'req-0bab4638-bf38-498b-9e9b-53398c0d42ed'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.609189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] The token cache is being invalidate because project 8040ec3f74804e36af7f3d14b04f9903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:19:10.609478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.610104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.611692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1318/2661] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:19:10 2022] DELETE /identity/v3/projects/8040ec3f74804e36af7f3d14b04f9903 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:19:10.615717 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:10.625390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a682d5-9da7-466f-a633-f365e4e4f4e7 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:10.642744 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:10.682599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:10.683215 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:10.683519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:10.683785 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] PATH_INFO: `/v3/users/ce221cb5d2e44912abc0813e8460b226` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:10.685279 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce221cb5d2e44912abc0813e8460b226)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:10.687177 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:10.732288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce221cb5d2e44912abc0813e8460b226'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.732921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce221cb5d2e44912abc0813e8460b226'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.744398 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce221cb5d2e44912abc0813e8460b226'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.745016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce221cb5d2e44912abc0813e8460b226'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.751894 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-88843668-9a34-4454-81cc-8db10396f4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce221cb5d2e44912abc0813e8460b226'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:10.764571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1344/2662] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:19:10 2022] DELETE /identity/v3/users/ce221cb5d2e44912abc0813e8460b226 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:19:11.041246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.042796 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:11.056723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4638-bf38-498b-9e9b-53398c0d42ed admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.116221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.116841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.117113 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.117381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] PATH_INFO: `/v3/projects/ab2f469577e64b9e9fd2548df4cc278f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.118478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2f469577e64b9e9fd2548df4cc278f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.120410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.150518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:11.168045 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2f469577e64b9e9fd2548df4cc278f', 'request_id': 'req-c73f9887-a722-4bf7-9820-1affd7adc84d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:11.175011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2f469577e64b9e9fd2548df4cc278f', 'request_id': 'req-c73f9887-a722-4bf7-9820-1affd7adc84d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:11.180975 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2f469577e64b9e9fd2548df4cc278f', 'request_id': 'req-c73f9887-a722-4bf7-9820-1affd7adc84d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:11.192107 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] The token cache is being invalidate because project ab2f469577e64b9e9fd2548df4cc278f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:19:11.192396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:11.193030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c73f9887-a722-4bf7-9820-1affd7adc84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:11.194508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1319/2663] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:19:11 2022] DELETE /identity/v3/projects/ab2f469577e64b9e9fd2548df4cc278f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:19:11.199812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cff16-e2fa-4611-a731-352186355c97 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.200176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cff16-e2fa-4611-a731-352186355c97 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.200462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cff16-e2fa-4611-a731-352186355c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.220658 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f27cff16-e2fa-4611-a731-352186355c97 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:11.221869 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f27cff16-e2fa-4611-a731-352186355c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:11.281354 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1345/2664] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:11.289332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951b62-5f46-4341-9476-0f23f106843f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.289685 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951b62-5f46-4341-9476-0f23f106843f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.290023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951b62-5f46-4341-9476-0f23f106843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.310243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4f951b62-5f46-4341-9476-0f23f106843f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:11.311479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4f951b62-5f46-4341-9476-0f23f106843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:11.319652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1320/2665] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:11.323867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cff16-e2fa-4611-a731-352186355c97 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.334101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cff16-e2fa-4611-a731-352186355c97 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.338610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.339209 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.339518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.340766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.341913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:19:11.342308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.344127 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.356852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1346/2666] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:19:11.361840 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951b62-5f46-4341-9476-0f23f106843f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.371223 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951b62-5f46-4341-9476-0f23f106843f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.375945 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.376543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.376822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.377095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.377716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.379651 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.410886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1321/2667] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:19:11 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:19:11.415036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.425633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568bd61-e707-4b96-9b99-04416b2f00ad admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.451739 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:11.484310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.484914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.485191 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.485467 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.486090 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.488028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.508375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1347/2668] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:19:11 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:19:11.512513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.522669 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ebda-9f4b-4f7f-ac10-007395a43020 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.527159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.527778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.528055 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.528323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.529456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.531030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.540652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1322/2669] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:19:11.544944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.554915 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe62723-eb78-45f7-84c2-f09dbd5a2f19 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.559475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac734-1384-49d6-9fb6-a67360688f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.560163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac734-1384-49d6-9fb6-a67360688f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.560440 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac734-1384-49d6-9fb6-a67360688f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.560711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac734-1384-49d6-9fb6-a67360688f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.561350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac734-1384-49d6-9fb6-a67360688f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.562925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac734-1384-49d6-9fb6-a67360688f78 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.573948 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1348/2670] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:19:11.578198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.588054 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094af612-bcb4-4c8b-8c14-a019a61e0ea2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.593360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.594020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.594302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.594581 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] PATH_INFO: `/v3/projects/d9a3c8fe719445d3b862d1e07610ffe8/users/b6b8b4bbc67d46fc979f130f7b25a167/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.610131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a3c8fe719445d3b862d1e07610ffe8, user_id=b6b8b4bbc67d46fc979f130f7b25a167, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.612857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.625417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1323/2671] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:19:11 2022] PUT /identity/v3/projects/d9a3c8fe719445d3b862d1e07610ffe8/users/b6b8b4bbc67d46fc979f130f7b25a167/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:19:11.630449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a702-d8c7-4fd3-a454-6ecfa704f215 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.630906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a702-d8c7-4fd3-a454-6ecfa704f215 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.631002 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a702-d8c7-4fd3-a454-6ecfa704f215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.650472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cb95a702-d8c7-4fd3-a454-6ecfa704f215 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:11.651707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cb95a702-d8c7-4fd3-a454-6ecfa704f215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:11.710443 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1349/2672] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:11.720667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:11.722371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:11.783935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887a76-c314-4518-ab27-b24bbd94fdaa admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:11.787687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:11.788296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:11.788578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:11.788838 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:11.797853 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:11.799237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:11.808308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1324/2673] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:19:12.442210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaf024-c413-4302-961d-469331b6838b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:12.442494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaf024-c413-4302-961d-469331b6838b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:12.442761 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaf024-c413-4302-961d-469331b6838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:12.469913 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1bcaf024-c413-4302-961d-469331b6838b None None] MFA Rules not processed for user `b6b8b4bbc67d46fc979f130f7b25a167`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:12.471119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1bcaf024-c413-4302-961d-469331b6838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:12.538417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1350/2674] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:12.550451 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:12.551985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:12.614316 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:12.637070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139bd1-8009-4ff4-8cd9-27b446bd49a0 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:12.640815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:12.641410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:12.641682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:12.641950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:12.649979 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:12.651401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:12.660016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1325/2675] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:19:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:19:14.063626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:14.064228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:14.064228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:14.083731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] MFA Rules not processed for user `b6b8b4bbc67d46fc979f130f7b25a167`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:14.084933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:14.092463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1351/2676] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:15.143810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:15.145523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:15.362700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc546a4-00b5-4fcd-ba4c-1af80fe1dcf4 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:15.367631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3026ea8-89ed-4429-8b34-4bb69bd6de7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:15.368225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026ea8-89ed-4429-8b34-4bb69bd6de7d service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:15.368492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026ea8-89ed-4429-8b34-4bb69bd6de7d service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:15.368753 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026ea8-89ed-4429-8b34-4bb69bd6de7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:15.370427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d3026ea8-89ed-4429-8b34-4bb69bd6de7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:15.382121 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3026ea8-89ed-4429-8b34-4bb69bd6de7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:15.383713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3026ea8-89ed-4429-8b34-4bb69bd6de7d service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:15.393308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1326/2677] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:19:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:19:18.152646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:18.154052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:18.167798 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc322-ee89-4d5d-82be-bd193144ceb7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:18.172663 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:18.173287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:18.173558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:18.173825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] PATH_INFO: `/v3/users/a8b7c04866c54691ba73645e141023c4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:18.175040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b7c04866c54691ba73645e141023c4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:18.176967 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:18.207642 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:18.234814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b7c04866c54691ba73645e141023c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.235501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b7c04866c54691ba73645e141023c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.247276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b7c04866c54691ba73645e141023c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.248483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b7c04866c54691ba73645e141023c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.255131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b7c04866c54691ba73645e141023c4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.268241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1352/2678] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:19:18 2022] DELETE /identity/v3/users/a8b7c04866c54691ba73645e141023c4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:19:18.272929 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:18.273415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:18.273543 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:18.292498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:18.293684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:18.352049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1327/2679] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:18.362220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:18.363686 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:18.419029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfd26e-4fcf-4a89-bcb2-2210acb517e4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:18.423213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38763c-4965-4568-88bb-fbeaac0a4113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:18.423853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38763c-4965-4568-88bb-fbeaac0a4113 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:18.424130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38763c-4965-4568-88bb-fbeaac0a4113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:18.424397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38763c-4965-4568-88bb-fbeaac0a4113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:18.433134 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38763c-4965-4568-88bb-fbeaac0a4113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:18.434550 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38763c-4965-4568-88bb-fbeaac0a4113 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:18.444621 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1353/2680] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:19:18.722103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:18.723609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:18.736508 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22e385-6c3a-4e29-9a9f-a8d4918bdc53 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:18.741092 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:18.741734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:18.742026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:18.742440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] PATH_INFO: `/v3/projects/9d3731760c0148949dc2d01c43295891` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:18.743591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3731760c0148949dc2d01c43295891)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:18.745528 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:18.788597 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:18.796263 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3731760c0148949dc2d01c43295891', 'request_id': 'req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.803402 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3731760c0148949dc2d01c43295891', 'request_id': 'req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.809872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3731760c0148949dc2d01c43295891', 'request_id': 'req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.822109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] The token cache is being invalidate because project 9d3731760c0148949dc2d01c43295891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:19:18.822393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.823029 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6dd4f0b-5651-4da9-b561-7c3f11df18b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:19:18.824511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1328/2681] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:19:18 2022] DELETE /identity/v3/projects/9d3731760c0148949dc2d01c43295891 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:19:28.440565 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=6,keystone:SELECT=45,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:28.819087 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:30.873930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116533c5-4fd8-46a8-bbfb-16dcfe03102e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:30.874463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116533c5-4fd8-46a8-bbfb-16dcfe03102e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:30.874463 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116533c5-4fd8-46a8-bbfb-16dcfe03102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:30.893512 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-116533c5-4fd8-46a8-bbfb-16dcfe03102e None None] MFA Rules not processed for user `b6b8b4bbc67d46fc979f130f7b25a167`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:30.894734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-116533c5-4fd8-46a8-bbfb-16dcfe03102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:30.951730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1354/2682] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:19:33.799279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:33.799912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:33.799912 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:33.820073 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] MFA Rules not processed for user `d295daeedd334a50980a57b99f0d794b`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:33.821280 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:33.888981 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1329/2683] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:19:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:40.944662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=25 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:43.878494 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=25 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:19:50.055106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d55e64-9193-49b2-87b5-c937184dd6fd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:50.055668 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d55e64-9193-49b2-87b5-c937184dd6fd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:50.055854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d55e64-9193-49b2-87b5-c937184dd6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:50.088210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a2d55e64-9193-49b2-87b5-c937184dd6fd None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:19:50.089424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a2d55e64-9193-49b2-87b5-c937184dd6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:50.156034 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1355/2684] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:19:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:19:50.203592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:19:50.204990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:19:50.275436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7a5ff-6cbe-49a5-8065-70f507c41de6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:19:50.280629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:19:50.281231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:19:50.281507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:19:50.281800 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:19:50.289764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:19:50.291336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:19:50.299722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1330/2685] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:19:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:20:00.149724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=32 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:00.296429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=32 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:05.609286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:05.609754 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:05.609840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:05.629604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:05.630833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:05.637896 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1356/2686] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 08:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:20:05.650430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:05.661193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ecd8-c35c-4fcb-bda2-578095af3b57 service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:05.666696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:05.667428 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:05.667720 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:05.667992 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:05.678430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:05.680093 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:05.689038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1331/2687] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:20:07.619795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:07.621303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:07.696866 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200d63-344d-44c9-8beb-c7b809e58fe2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:07.701615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:07.702404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:07.702687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:07.702962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] PATH_INFO: `/v3/users/b6b8b4bbc67d46fc979f130f7b25a167` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:07.704160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b8b4bbc67d46fc979f130f7b25a167)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:07.706120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:07.755376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b8b4bbc67d46fc979f130f7b25a167'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:07.756059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b8b4bbc67d46fc979f130f7b25a167'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:07.768835 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b8b4bbc67d46fc979f130f7b25a167'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:07.769597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b8b4bbc67d46fc979f130f7b25a167'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:07.776556 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54e49bd3-8b59-46ab-ad02-0e03c8d74160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b8b4bbc67d46fc979f130f7b25a167'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:07.790459 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1357/2688] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:20:07 2022] DELETE /identity/v3/users/b6b8b4bbc67d46fc979f130f7b25a167 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:07.964738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:07.975953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402b09e-58b5-428b-9968-4de24ccabb45 service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.039611 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.040313 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.040592 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.040867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] PATH_INFO: `/v3/projects/d9a3c8fe719445d3b862d1e07610ffe8` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.041984 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a3c8fe719445d3b862d1e07610ffe8)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.043931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.088362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a3c8fe719445d3b862d1e07610ffe8', 'request_id': 'req-ed23042a-af7e-4295-8455-4cebba041ca3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:08.097330 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a3c8fe719445d3b862d1e07610ffe8', 'request_id': 'req-ed23042a-af7e-4295-8455-4cebba041ca3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:08.103068 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a3c8fe719445d3b862d1e07610ffe8', 'request_id': 'req-ed23042a-af7e-4295-8455-4cebba041ca3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:08.115265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] The token cache is being invalidate because project d9a3c8fe719445d3b862d1e07610ffe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:20:08.115748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:08.116440 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ed23042a-af7e-4295-8455-4cebba041ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:08.118188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1332/2689] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:20:07 2022] DELETE /identity/v3/projects/d9a3c8fe719445d3b862d1e07610ffe8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:08.122918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605930-fee8-4343-8004-ddc9c5e24798 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.123427 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605930-fee8-4343-8004-ddc9c5e24798 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.123756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605930-fee8-4343-8004-ddc9c5e24798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.144776 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-77605930-fee8-4343-8004-ddc9c5e24798 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:08.146006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-77605930-fee8-4343-8004-ddc9c5e24798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:08.217795 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1358/2690] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:20:08.226678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c20f65-f250-4660-906f-56a2fe0cc367 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.226960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c20f65-f250-4660-906f-56a2fe0cc367 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.227235 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c20f65-f250-4660-906f-56a2fe0cc367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.251431 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-85c20f65-f250-4660-906f-56a2fe0cc367 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:08.252655 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-85c20f65-f250-4660-906f-56a2fe0cc367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:08.262947 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1333/2691] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:20:08.268169 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605930-fee8-4343-8004-ddc9c5e24798 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:08.279117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605930-fee8-4343-8004-ddc9c5e24798 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.284223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.284837 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.285116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.285388 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.286041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:20:08.286342 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.288124 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.303065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:08.311839 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1359/2692] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:20:08.314256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c20f65-f250-4660-906f-56a2fe0cc367 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:08.324738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c20f65-f250-4660-906f-56a2fe0cc367 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.334433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.334668 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.334829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.335265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.335943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.337961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.367340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1334/2693] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:20:08 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:20:08.371481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:08.382224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b34fa-5899-4b98-a0bb-2f34b08be40a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.439036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.439036 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.439280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.439498 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.440271 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.442801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.465840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1360/2694] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:20:08 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:20:08.470190 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:08.480656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5f01-1f06-4855-8950-646a560b9052 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.485269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.485865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.486132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.486393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.487017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.488615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.500343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1335/2695] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:20:08.505529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:08.516778 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717ba93-d860-471e-8491-e982a52efe72 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.521516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5cbe-8e39-40e3-9a26-4867342ccb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.522185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5cbe-8e39-40e3-9a26-4867342ccb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.522526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5cbe-8e39-40e3-9a26-4867342ccb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.522861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5cbe-8e39-40e3-9a26-4867342ccb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.523602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff5cbe-8e39-40e3-9a26-4867342ccb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.525247 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff5cbe-8e39-40e3-9a26-4867342ccb70 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.536533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1361/2696] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:20:08.547949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:08.559246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2d8a-f206-423e-b006-eab927bdf6b8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.565938 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.566599 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.566870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.567139 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] PATH_INFO: `/v3/projects/059d9aea1cb049ac826f88e29b28a808/users/c38f3b10b9a44c1aae5c7e1f989110d5/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.582671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=059d9aea1cb049ac826f88e29b28a808, user_id=c38f3b10b9a44c1aae5c7e1f989110d5, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.585461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.599612 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1336/2697] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:20:08 2022] PUT /identity/v3/projects/059d9aea1cb049ac826f88e29b28a808/users/c38f3b10b9a44c1aae5c7e1f989110d5/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:08.610650 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.610930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.611198 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.642647 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] MFA Rules not processed for user `c38f3b10b9a44c1aae5c7e1f989110d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:08.643923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:08.711159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1362/2698] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:20:08.729048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:08.731102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:08.746933 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:08.793237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fffff-f3ae-491b-93ba-19a337f3f7b8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:08.797660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:08.798262 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:08.798537 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:08.798806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:08.806956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:08.808445 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:08.818141 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1337/2699] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:20:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:20:18.708503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:18.742864 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:18.744478 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:18.814293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=20 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:18.816541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d4c31-a7ee-4588-a823-cc5f06523715 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:18.821364 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:18.822416 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:18.822922 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:18.823404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:18.827097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:18.913982 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:18.914494 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:18.926840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1363/2700] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:20:21.850435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:21.851931 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:21.939403 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43af5df-391d-4fcb-8996-e3d2ffae906a service glance] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:21.945700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:21.946570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:21.946845 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:21.951536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:21.953966 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:21.973594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:21.975306 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:21.986400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1338/2701] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:20:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:20:25.105013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:25.106786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:25.120691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1349d-3160-4122-ac9f-5df220a15737 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:25.125528 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:25.126174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:25.126453 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:25.126728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] PATH_INFO: `/v3/users/b83b1a254074456897dcb9430e29d4b7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:25.127890 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83b1a254074456897dcb9430e29d4b7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:25.129842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:25.184100 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83b1a254074456897dcb9430e29d4b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.184889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83b1a254074456897dcb9430e29d4b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.197452 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83b1a254074456897dcb9430e29d4b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.198147 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83b1a254074456897dcb9430e29d4b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.206676 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83b1a254074456897dcb9430e29d4b7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.220006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1364/2702] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:20:25 2022] DELETE /identity/v3/users/b83b1a254074456897dcb9430e29d4b7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:25.405246 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:25.415812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c3dbb-bc54-43fa-9731-2f5b9e62f8fe service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:25.478993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:25.479644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:25.479916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:25.480204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] PATH_INFO: `/v3/projects/4c0b8cce674f4a7581301575ea567b80` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:25.481298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0b8cce674f4a7581301575ea567b80)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:25.483928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:25.526935 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0b8cce674f4a7581301575ea567b80', 'request_id': 'req-d4db7091-ed28-4371-b989-ce7b8909869d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.534770 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0b8cce674f4a7581301575ea567b80', 'request_id': 'req-d4db7091-ed28-4371-b989-ce7b8909869d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.540230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0b8cce674f4a7581301575ea567b80', 'request_id': 'req-d4db7091-ed28-4371-b989-ce7b8909869d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.551788 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] The token cache is being invalidate because project 4c0b8cce674f4a7581301575ea567b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:20:25.552074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.552691 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.554169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1339/2703] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:20:25 2022] DELETE /identity/v3/projects/4c0b8cce674f4a7581301575ea567b80 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:25.558189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:25.560161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:25.573929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ca8a-23c9-4800-bfbe-26718e3fcc60 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:25.592829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:25.632451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:25.633078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:25.633352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:25.633622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] PATH_INFO: `/v3/users/a54eb7c86a9e4fc88a5bca787fa92b4c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:25.634735 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54eb7c86a9e4fc88a5bca787fa92b4c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:25.636832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:25.682594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54eb7c86a9e4fc88a5bca787fa92b4c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.683217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54eb7c86a9e4fc88a5bca787fa92b4c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.695712 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54eb7c86a9e4fc88a5bca787fa92b4c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.696341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54eb7c86a9e4fc88a5bca787fa92b4c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.703682 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54eb7c86a9e4fc88a5bca787fa92b4c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:25.716681 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1365/2704] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:20:25 2022] DELETE /identity/v3/users/a54eb7c86a9e4fc88a5bca787fa92b4c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:25.897206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:25.898707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:25.911647 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db7091-ed28-4371-b989-ce7b8909869d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:25.929272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:25.972712 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:25.973363 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:25.973639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:25.973908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] PATH_INFO: `/v3/projects/78056d4a94c64f9593f1e0124474d5c6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:25.975038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78056d4a94c64f9593f1e0124474d5c6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:25.977009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:26.022136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78056d4a94c64f9593f1e0124474d5c6', 'request_id': 'req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:26.028475 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78056d4a94c64f9593f1e0124474d5c6', 'request_id': 'req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:26.034050 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78056d4a94c64f9593f1e0124474d5c6', 'request_id': 'req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:26.045414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] The token cache is being invalidate because project 78056d4a94c64f9593f1e0124474d5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:20:26.045700 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:26.046339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:26.047829 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1340/2705] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:20:25 2022] DELETE /identity/v3/projects/78056d4a94c64f9593f1e0124474d5c6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:35.712725 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:36.041785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:38.363464 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:38.364889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:38.424851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259ca1-fb90-495a-9277-1601aca84649 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:38.472687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2d727-39ae-4d04-96ac-2052feddd3ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:38.473289 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2d727-39ae-4d04-96ac-2052feddd3ee service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:38.473567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2d727-39ae-4d04-96ac-2052feddd3ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:38.473840 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2d727-39ae-4d04-96ac-2052feddd3ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:38.475615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d7b2d727-39ae-4d04-96ac-2052feddd3ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:38.555980 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2d727-39ae-4d04-96ac-2052feddd3ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:38.557404 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2d727-39ae-4d04-96ac-2052feddd3ee service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:38.577905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1366/2706] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:20:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:20:40.160717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:40.162137 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:40.224438 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ede41-f1aa-483c-bf3e-66d976bb4cf4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:40.228842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:40.229449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:40.229721 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:40.229989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] PATH_INFO: `/v3/users/c38f3b10b9a44c1aae5c7e1f989110d5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:40.231074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38f3b10b9a44c1aae5c7e1f989110d5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:40.233138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:40.286023 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38f3b10b9a44c1aae5c7e1f989110d5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.298237 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38f3b10b9a44c1aae5c7e1f989110d5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.305164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38f3b10b9a44c1aae5c7e1f989110d5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.305856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38f3b10b9a44c1aae5c7e1f989110d5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.306466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38f3b10b9a44c1aae5c7e1f989110d5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.319343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1341/2707] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:20:40 2022] DELETE /identity/v3/users/c38f3b10b9a44c1aae5c7e1f989110d5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:40.323895 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:40.324375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:40.324484 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:40.344024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:40.345220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:40.376956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:40.404042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1367/2708] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:20:40.413574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:40.414956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:40.471622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073917df-b8cf-49a3-af3f-ad33de2eefbc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:40.475192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a57ecd-5d5d-4b6d-9fed-89fecf3e9bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:40.475805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a57ecd-5d5d-4b6d-9fed-89fecf3e9bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:40.476077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a57ecd-5d5d-4b6d-9fed-89fecf3e9bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:40.476340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a57ecd-5d5d-4b6d-9fed-89fecf3e9bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:40.485009 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a57ecd-5d5d-4b6d-9fed-89fecf3e9bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:40.486423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a57ecd-5d5d-4b6d-9fed-89fecf3e9bc6 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:40.495486 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1342/2709] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:20:40.760959 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:40.762638 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:40.781424 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7662f-ad63-4e30-827f-fdc8a8a4dfdb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:40.789509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:40.790202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:40.790530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:40.790918 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] PATH_INFO: `/v3/projects/059d9aea1cb049ac826f88e29b28a808` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:40.792217 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=059d9aea1cb049ac826f88e29b28a808)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:40.795981 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:40.845141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059d9aea1cb049ac826f88e29b28a808', 'request_id': 'req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.851148 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059d9aea1cb049ac826f88e29b28a808', 'request_id': 'req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.856691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059d9aea1cb049ac826f88e29b28a808', 'request_id': 'req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.868714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] The token cache is being invalidate because project 059d9aea1cb049ac826f88e29b28a808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:20:40.869005 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.869645 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cdf969d-8c6e-45c4-9942-8a7b38a1d280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:20:40.871117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1368/2710] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:20:40 2022] DELETE /identity/v3/projects/059d9aea1cb049ac826f88e29b28a808 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:20:40.876016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25f93-908c-4fea-aeb8-b9567e3d2042 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:40.876304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25f93-908c-4fea-aeb8-b9567e3d2042 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:40.876601 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25f93-908c-4fea-aeb8-b9567e3d2042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:40.897345 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-94d25f93-908c-4fea-aeb8-b9567e3d2042 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:40.898541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-94d25f93-908c-4fea-aeb8-b9567e3d2042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:40.915684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:40.958274 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1343/2711] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:20:40.965928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de081f7a-4214-41f4-92ee-6065b88cd989 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:40.966753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de081f7a-4214-41f4-92ee-6065b88cd989 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:40.967079 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de081f7a-4214-41f4-92ee-6065b88cd989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:40.986892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-de081f7a-4214-41f4-92ee-6065b88cd989 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:40.988117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-de081f7a-4214-41f4-92ee-6065b88cd989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:40.995947 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1369/2712] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:20:41.000394 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25f93-908c-4fea-aeb8-b9567e3d2042 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:41.009920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25f93-908c-4fea-aeb8-b9567e3d2042 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:41.015119 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:41.015731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.015999 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.016324 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.016961 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:20:41.017256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:41.018819 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:41.030131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1344/2713] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:20:41.034288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de081f7a-4214-41f4-92ee-6065b88cd989 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:41.043323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de081f7a-4214-41f4-92ee-6065b88cd989 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:41.048880 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:41.049469 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.049745 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.050039 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.050652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:41.052560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:41.090743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1370/2714] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:20:41 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:20:41.096476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:41.106393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00835e-5517-434a-aff3-bb090962e8ce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:41.161781 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:41.162447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.162623 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.162891 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.163524 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:41.165421 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:41.185590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1345/2715] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:20:41 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:20:41.190038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:41.200163 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6bf7-9067-4524-9862-5f85829d0cec admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:41.205505 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:41.206104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.206410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.206678 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.207310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:41.208916 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:41.219784 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1371/2716] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:20:41.223605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:41.234381 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6578a-f123-48da-87e3-762021a1ed56 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:41.238897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384603ca-ffb8-4f90-8517-bc269abc510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:41.239515 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384603ca-ffb8-4f90-8517-bc269abc510c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.239793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384603ca-ffb8-4f90-8517-bc269abc510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.240063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384603ca-ffb8-4f90-8517-bc269abc510c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.240696 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384603ca-ffb8-4f90-8517-bc269abc510c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:41.242266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384603ca-ffb8-4f90-8517-bc269abc510c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:41.252684 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1346/2717] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:20:41.256538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:41.267071 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73dd27-720c-48c4-96b3-6cc4d9c0ca9f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:41.271926 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:41.272569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.272846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.273119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] PATH_INFO: `/v3/projects/06a4875d56b24404974048165b0ed068/users/1c29d3eee5b34f36a13c0ea462fd344f/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.288575 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a4875d56b24404974048165b0ed068, user_id=1c29d3eee5b34f36a13c0ea462fd344f, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:41.291262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:41.307619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1372/2718] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:20:41 2022] PUT /identity/v3/projects/06a4875d56b24404974048165b0ed068/users/1c29d3eee5b34f36a13c0ea462fd344f/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:20:41.317847 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.318123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.318397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.345927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] MFA Rules not processed for user `1c29d3eee5b34f36a13c0ea462fd344f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:20:41.347125 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:41.410102 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1347/2719] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:20:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:20:41.422705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:41.424545 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:41.476393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:41.480146 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201c91-6118-4f67-94f8-25eedf0271f3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:41.485836 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:41.486655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:41.487097 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:41.487450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:41.495885 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:41.497374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:41.506040 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1373/2720] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:20:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:20:46.616503 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:20:46.618034 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:46.631120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6cc58-7c0c-4d03-a667-771fbc742cad None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:20:46.635003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:20:46.635759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:20:46.636103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:20:46.636441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:20:46.638776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:20:46.652854 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:46.713507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:20:46.715049 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:20:46.728456 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1348/2721] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:20:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:20:51.502142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:20:56.723507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=26 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:00.867122 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:00.876551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafecf0-638e-4927-ac95-073164206de0 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:00.880187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:00.880781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:00.881059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:00.881327 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:00.883093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:00.945908 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:00.947334 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:00.957049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1374/2722] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:01.057435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:01.058861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:01.118153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958e1e2-c912-44cd-9184-6e423a7193f1 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:01.121735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:01.122955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:01.123232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:01.123530 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:01.125236 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:01.193682 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:01.195126 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:01.204921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1349/2723] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:04.568664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:04.570226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:04.584953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af4386-b1b8-4d0a-abba-99bfde53511b service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:04.589616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:04.590257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:04.591181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:04.591491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] PATH_INFO: `/v3/users/d295daeedd334a50980a57b99f0d794b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:04.592660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d295daeedd334a50980a57b99f0d794b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:04.594571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:04.648675 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd295daeedd334a50980a57b99f0d794b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:04.649723 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd295daeedd334a50980a57b99f0d794b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:04.662307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd295daeedd334a50980a57b99f0d794b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:04.662929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd295daeedd334a50980a57b99f0d794b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:04.671011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0d110d05-000a-4dff-9293-82582619652b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd295daeedd334a50980a57b99f0d794b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:04.690207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1375/2724] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:04 2022] DELETE /identity/v3/users/d295daeedd334a50980a57b99f0d794b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:04.867614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:04.878004 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e77a14-e082-40eb-af0d-93a6e0dc0f8f service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:04.940972 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:04.941533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:04.941805 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:04.942072 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] PATH_INFO: `/v3/projects/850e62ec7f6345469e83ac4aac857816` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:04.943171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=850e62ec7f6345469e83ac4aac857816)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:04.945091 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:04.992389 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850e62ec7f6345469e83ac4aac857816', 'request_id': 'req-2a4b4972-cbba-45ef-9b6c-192a199301ed'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:04.994883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:05.000646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850e62ec7f6345469e83ac4aac857816', 'request_id': 'req-2a4b4972-cbba-45ef-9b6c-192a199301ed'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:05.007643 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850e62ec7f6345469e83ac4aac857816', 'request_id': 'req-2a4b4972-cbba-45ef-9b6c-192a199301ed'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:05.019936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] The token cache is being invalidate because project 850e62ec7f6345469e83ac4aac857816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:05.020231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:05.020899 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2a4b4972-cbba-45ef-9b6c-192a199301ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:05.022371 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1350/2725] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:04 2022] DELETE /identity/v3/projects/850e62ec7f6345469e83ac4aac857816 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:05.027201 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87202a-c543-480a-8ab8-0882ea8fbc6f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.027518 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87202a-c543-480a-8ab8-0882ea8fbc6f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.027792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87202a-c543-480a-8ab8-0882ea8fbc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.047312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3f87202a-c543-480a-8ab8-0882ea8fbc6f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:05.048531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3f87202a-c543-480a-8ab8-0882ea8fbc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:05.109581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1376/2726] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:05.118970 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0827e6d-ae7c-48f8-bcfb-2d168b6bc6d0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.119252 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0827e6d-ae7c-48f8-bcfb-2d168b6bc6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.119568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0827e6d-ae7c-48f8-bcfb-2d168b6bc6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.140397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a0827e6d-ae7c-48f8-bcfb-2d168b6bc6d0 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:05.141608 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a0827e6d-ae7c-48f8-bcfb-2d168b6bc6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:05.149397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1351/2727] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:05.154387 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87202a-c543-480a-8ab8-0882ea8fbc6f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.164210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87202a-c543-480a-8ab8-0882ea8fbc6f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.169907 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.170812 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.171095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.171369 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.172068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:05.172374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.173979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.181230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:05.191298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1377/2728] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:05.192373 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0827e6d-ae7c-48f8-bcfb-2d168b6bc6d0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.202094 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0827e6d-ae7c-48f8-bcfb-2d168b6bc6d0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.206803 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.207393 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.207706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.207974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.208596 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.210487 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.241656 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1352/2729] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:05 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:05.245955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.256677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea83ab9-a5a9-43bd-b1d5-e728be23a761 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.328728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.329345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.329618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.329886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.330508 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.332461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.357569 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1378/2730] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:05 2022] POST /identity/v3/users => generated 278 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:05.361646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.372321 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaadd5e-775e-45d9-aaf6-9cf8ca8ff456 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.376965 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.377557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.377836 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.378103 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.378738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.380349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.392089 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1353/2731] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:05.396099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.406076 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fe73-6ce8-4822-847b-06b24fc4c380 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.410788 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de03541-c504-4590-9d94-dc5426263401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.411436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03541-c504-4590-9d94-dc5426263401 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.411716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03541-c504-4590-9d94-dc5426263401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.411990 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03541-c504-4590-9d94-dc5426263401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.412625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de03541-c504-4590-9d94-dc5426263401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.414210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de03541-c504-4590-9d94-dc5426263401 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.425019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1379/2732] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:05.430042 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.440497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09625-685b-4d22-82f1-6c25642c916d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.445323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.445942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.446248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.446629 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] PATH_INFO: `/v3/projects/74dc9d83a76849ef94246f5172be126a/users/b6f83f3585dd483886062d4ed87d1d10/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.461905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dc9d83a76849ef94246f5172be126a, user_id=b6f83f3585dd483886062d4ed87d1d10, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.464688 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.479575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1354/2733] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:05 2022] PUT /identity/v3/projects/74dc9d83a76849ef94246f5172be126a/users/b6f83f3585dd483886062d4ed87d1d10/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:05.489984 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f1cc-89cf-4cc3-8bb4-232cdba6fb09 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.490264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f1cc-89cf-4cc3-8bb4-232cdba6fb09 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.490533 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f1cc-89cf-4cc3-8bb4-232cdba6fb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.520662 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6277f1cc-89cf-4cc3-8bb4-232cdba6fb09 None None] MFA Rules not processed for user `b6f83f3585dd483886062d4ed87d1d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:05.521914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6277f1cc-89cf-4cc3-8bb4-232cdba6fb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:05.586944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1380/2734] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:05.591857 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.656507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c7e8f-a098-4b31-a297-23df04b5b591 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.661145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.661744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.662020 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.662291 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.662913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.664831 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.693924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1355/2735] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:05 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:21:05.698381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f1cc-89cf-4cc3-8bb4-232cdba6fb09 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.710583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f1cc-89cf-4cc3-8bb4-232cdba6fb09 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.769317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.769931 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.770213 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.770490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.771109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.773095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.784914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:05.796743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1381/2736] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:05 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:05.800814 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.812202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc6ea-636f-49e3-948c-3d429e57f003 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.817978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.818591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.818866 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.819136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.819812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.821415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.834101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1356/2737] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:21:05.838331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.849356 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc100a5-efb5-4b86-b678-873f27bc9830 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.858588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.859274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.859587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.859862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] PATH_INFO: `/v3/projects/fffe795aef5549c2aebfc23ce6488d17/users/f5e42366141a43a4890d44be4d44e56c/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.876701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffe795aef5549c2aebfc23ce6488d17, user_id=f5e42366141a43a4890d44be4d44e56c, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.879355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.894563 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1382/2738] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:05 2022] PUT /identity/v3/projects/fffe795aef5549c2aebfc23ce6488d17/users/f5e42366141a43a4890d44be4d44e56c/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:05.898506 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.909385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a76d-36bc-4edb-9a81-221be75a2a01 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:05.957326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:05.968033 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a29a-9f4b-4bd2-b46e-f03715d253b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:05.968630 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a29a-9f4b-4bd2-b46e-f03715d253b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:05.968901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a29a-9f4b-4bd2-b46e-f03715d253b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:05.969169 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a29a-9f4b-4bd2-b46e-f03715d253b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:05.969793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8a29a-9f4b-4bd2-b46e-f03715d253b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:05.971366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8a29a-9f4b-4bd2-b46e-f03715d253b4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:05.980820 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1357/2739] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:05.985520 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:05.997095 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7eb8-3385-485d-8798-435f3aabba83 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:06.001731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:06.002377 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:06.002648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:06.002914 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] PATH_INFO: `/v3/projects/fffe795aef5549c2aebfc23ce6488d17/users/f5e42366141a43a4890d44be4d44e56c/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:06.004825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffe795aef5549c2aebfc23ce6488d17, user_id=f5e42366141a43a4890d44be4d44e56c, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:06.007490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:06.017970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1383/2740] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:05 2022] PUT /identity/v3/projects/fffe795aef5549c2aebfc23ce6488d17/users/f5e42366141a43a4890d44be4d44e56c/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:06.028920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595775-4573-4f4a-acfd-e591246904ef None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:06.029206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595775-4573-4f4a-acfd-e591246904ef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:06.029639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595775-4573-4f4a-acfd-e591246904ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:06.056270 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-54595775-4573-4f4a-acfd-e591246904ef None None] MFA Rules not processed for user `f5e42366141a43a4890d44be4d44e56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:06.057450 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-54595775-4573-4f4a-acfd-e591246904ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:06.128989 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1358/2741] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:06.140838 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:06.142635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:06.203664 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b4ec-d6dd-42c9-a58f-888c380dd607 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:06.207275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:06.208028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:06.208253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:06.208521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:06.217690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:06.219105 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:06.228230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1384/2742] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:06.309897 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595775-4573-4f4a-acfd-e591246904ef None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:06.319826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595775-4573-4f4a-acfd-e591246904ef None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:06.323606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd51d8-e53e-4121-8b25-d14601080522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:06.324272 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd51d8-e53e-4121-8b25-d14601080522 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:06.324546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd51d8-e53e-4121-8b25-d14601080522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:06.324822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd51d8-e53e-4121-8b25-d14601080522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:06.382145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd51d8-e53e-4121-8b25-d14601080522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:06.383614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd51d8-e53e-4121-8b25-d14601080522 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:06.392370 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1359/2743] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:16.224176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=43,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:16.388417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=68 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:16.826779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:16.828203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:16.891328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d151a67-8d07-4bb6-8edb-517549c63301 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:16.895996 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:16.896624 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:16.896905 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:16.897185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] PATH_INFO: `/v3/users/1c29d3eee5b34f36a13c0ea462fd344f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:16.898328 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c29d3eee5b34f36a13c0ea462fd344f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:16.900276 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:16.945987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c29d3eee5b34f36a13c0ea462fd344f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:16.946643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c29d3eee5b34f36a13c0ea462fd344f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:16.958562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c29d3eee5b34f36a13c0ea462fd344f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:16.959175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c29d3eee5b34f36a13c0ea462fd344f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:16.966616 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c29d3eee5b34f36a13c0ea462fd344f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:16.978796 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1385/2744] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:16 2022] DELETE /identity/v3/users/1c29d3eee5b34f36a13c0ea462fd344f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:16.983430 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:16.983748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:16.984022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:17.002615 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:17.003823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:17.064986 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1360/2745] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:17.081106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:17.082529 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:17.141816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40664583-7c99-4dd9-bab9-0090d33eb813 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:17.146138 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:17.147047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:17.147325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:17.147626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:17.157863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:17.159446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:17.169629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1386/2746] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:17.439616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:17.441142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:17.453211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d74d-3b1a-4330-986d-a3ec27cd44e7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:17.457694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:17.458315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:17.458590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:17.458859 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] PATH_INFO: `/v3/projects/06a4875d56b24404974048165b0ed068` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:17.460017 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a4875d56b24404974048165b0ed068)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:17.461916 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:17.509202 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a4875d56b24404974048165b0ed068', 'request_id': 'req-c410d660-d65f-422a-9942-a169fb2fe9a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:17.517759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a4875d56b24404974048165b0ed068', 'request_id': 'req-c410d660-d65f-422a-9942-a169fb2fe9a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:17.523429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a4875d56b24404974048165b0ed068', 'request_id': 'req-c410d660-d65f-422a-9942-a169fb2fe9a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:17.534418 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] The token cache is being invalidate because project 06a4875d56b24404974048165b0ed068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:17.534702 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:17.535846 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c410d660-d65f-422a-9942-a169fb2fe9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:17.537303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1361/2747] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:17 2022] DELETE /identity/v3/projects/06a4875d56b24404974048165b0ed068 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:21.182340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:21.184442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:21.197254 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a987c-762a-4127-b0e6-07c918df448a service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:21.216425 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:21.256117 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:21.256734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:21.257006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:21.257275 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] PATH_INFO: `/v3/users/b6f83f3585dd483886062d4ed87d1d10` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:21.258368 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f83f3585dd483886062d4ed87d1d10)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:21.260566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:21.310753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f83f3585dd483886062d4ed87d1d10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.311393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f83f3585dd483886062d4ed87d1d10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.323307 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f83f3585dd483886062d4ed87d1d10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.323952 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f83f3585dd483886062d4ed87d1d10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.330591 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f83f3585dd483886062d4ed87d1d10'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.343390 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1387/2748] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:21 2022] DELETE /identity/v3/users/b6f83f3585dd483886062d4ed87d1d10 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:21.347895 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:21.348413 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:21.348546 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:21.367227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:21.368453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:21.426000 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1362/2749] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:21.435992 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:21.437790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:21.499577 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b0cee-ecae-493f-a193-be53a6713b53 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:21.503196 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:21.503826 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:21.504102 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:21.504371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:21.513831 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:21.515249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:21.524473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1388/2750] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:21.790473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:21.791953 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:21.804716 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f63451-e5e2-42e5-b815-d3d651612580 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:21.809785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:21.810407 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:21.810677 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:21.810941 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] PATH_INFO: `/v3/projects/74dc9d83a76849ef94246f5172be126a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:21.812211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74dc9d83a76849ef94246f5172be126a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:21.814366 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:21.836644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:21.862810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dc9d83a76849ef94246f5172be126a', 'request_id': 'req-9c09dc7b-8098-4f30-b545-f9adb815d283'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.870151 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dc9d83a76849ef94246f5172be126a', 'request_id': 'req-9c09dc7b-8098-4f30-b545-f9adb815d283'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.877667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dc9d83a76849ef94246f5172be126a', 'request_id': 'req-9c09dc7b-8098-4f30-b545-f9adb815d283'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.889194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] The token cache is being invalidate because project 74dc9d83a76849ef94246f5172be126a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:21.889479 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.890108 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:21.891609 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1363/2751] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:21 2022] DELETE /identity/v3/projects/74dc9d83a76849ef94246f5172be126a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:21:21.895560 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:21.905186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90629aa-c3dd-47c8-95be-8770e98d595d service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:21.947538 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:21.963938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:21.964559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:21.964859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:21.965768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] PATH_INFO: `/v3/users/f5e42366141a43a4890d44be4d44e56c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:21.966975 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e42366141a43a4890d44be4d44e56c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:21.968928 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.015161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e42366141a43a4890d44be4d44e56c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.015832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e42366141a43a4890d44be4d44e56c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.028096 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e42366141a43a4890d44be4d44e56c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.028870 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e42366141a43a4890d44be4d44e56c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.035817 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e24a2a4-5145-4562-9407-a1519c4b26de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e42366141a43a4890d44be4d44e56c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.048343 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1389/2752] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:21 2022] DELETE /identity/v3/users/f5e42366141a43a4890d44be4d44e56c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:22.317967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:22.320064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:22.338248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09dc7b-8098-4f30-b545-f9adb815d283 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:22.394962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:22.395652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.395881 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.396150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] PATH_INFO: `/v3/projects/fffe795aef5549c2aebfc23ce6488d17` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.397243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fffe795aef5549c2aebfc23ce6488d17)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:22.399118 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.444761 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fffe795aef5549c2aebfc23ce6488d17', 'request_id': 'req-07b71a02-5db6-4d04-84ed-c0c4645b3566'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.452412 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fffe795aef5549c2aebfc23ce6488d17', 'request_id': 'req-07b71a02-5db6-4d04-84ed-c0c4645b3566'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.458083 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fffe795aef5549c2aebfc23ce6488d17', 'request_id': 'req-07b71a02-5db6-4d04-84ed-c0c4645b3566'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.469053 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] The token cache is being invalidate because project fffe795aef5549c2aebfc23ce6488d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:22.469356 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.469967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-07b71a02-5db6-4d04-84ed-c0c4645b3566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:22.471461 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1364/2753] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:22 2022] DELETE /identity/v3/projects/fffe795aef5549c2aebfc23ce6488d17 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:22.476288 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ae44-17b0-4d15-a3be-e5f814806a14 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.476768 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ae44-17b0-4d15-a3be-e5f814806a14 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.476892 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ae44-17b0-4d15-a3be-e5f814806a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.495775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-80b2ae44-17b0-4d15-a3be-e5f814806a14 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:22.497736 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-80b2ae44-17b0-4d15-a3be-e5f814806a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:22.556594 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1390/2754] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:22.565207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddc2c-ae17-4717-89ed-65994f2d68d3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.565488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddc2c-ae17-4717-89ed-65994f2d68d3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.565758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddc2c-ae17-4717-89ed-65994f2d68d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.585785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b29ddc2c-ae17-4717-89ed-65994f2d68d3 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:22.586983 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b29ddc2c-ae17-4717-89ed-65994f2d68d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:22.594856 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1365/2755] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:22.598940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ae44-17b0-4d15-a3be-e5f814806a14 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:22.609357 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ae44-17b0-4d15-a3be-e5f814806a14 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:22.613938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:22.614536 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.614810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.615077 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.615771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:22.616070 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:22.617644 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.629582 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1391/2756] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:22.633920 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ddc2c-ae17-4717-89ed-65994f2d68d3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:22.643962 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ddc2c-ae17-4717-89ed-65994f2d68d3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:22.648591 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:22.649181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.649460 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.649729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.650352 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:22.652396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.678225 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1366/2757] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:22 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:22.682266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:22.693235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46630f-2d67-4cf2-bd0f-e8ea03ecb517 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:22.739142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:22.750521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:22.751072 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.751349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.751652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.752280 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:22.754193 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.774615 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1392/2758] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:22 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:22.778848 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:22.788882 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50b52-8518-4930-acb7-34ef1a362751 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:22.794074 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:22.794659 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.794937 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.795210 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.795886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:22.797467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.799497 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:22.811909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1367/2759] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:21:22.816179 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:22.826241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5b8f-9fbe-4c04-8942-4e478e757fee admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:22.830811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5f520-3b0f-406f-b693-12ee1b93da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:22.831393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f520-3b0f-406f-b693-12ee1b93da9a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.831709 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f520-3b0f-406f-b693-12ee1b93da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.831977 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f520-3b0f-406f-b693-12ee1b93da9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.832603 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5f520-3b0f-406f-b693-12ee1b93da9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:22.834178 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5f520-3b0f-406f-b693-12ee1b93da9a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.844483 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1393/2760] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:21:22.848439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:22.858990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369ecd-5ab6-49a3-95cd-4efdddd3d308 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:22.863589 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:22.864232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.864505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.864774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] PATH_INFO: `/v3/projects/b40f3c26241b4719a1a92fb897f7bdf9/users/86581b9ff2bc48bebb09bacc3b49f3a4/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.880205 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40f3c26241b4719a1a92fb897f7bdf9, user_id=86581b9ff2bc48bebb09bacc3b49f3a4, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:22.882906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:22.895605 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1368/2761] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:22 2022] PUT /identity/v3/projects/b40f3c26241b4719a1a92fb897f7bdf9/users/86581b9ff2bc48bebb09bacc3b49f3a4/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:21:22.905887 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f31c11-2b35-4e86-a138-d513193dbfce None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:22.906174 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f31c11-2b35-4e86-a138-d513193dbfce None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:22.906448 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f31c11-2b35-4e86-a138-d513193dbfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:22.935578 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-04f31c11-2b35-4e86-a138-d513193dbfce None None] MFA Rules not processed for user `86581b9ff2bc48bebb09bacc3b49f3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:22.936789 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-04f31c11-2b35-4e86-a138-d513193dbfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:22.999943 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1394/2762] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:23.004472 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:23.064540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa5b0-6fe9-4446-8c06-b642093b3bdd admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:23.069136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:23.069731 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.070022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.070279 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.070889 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:23.072822 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:23.099016 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1369/2763] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:23 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:21:23.103186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f31c11-2b35-4e86-a138-d513193dbfce None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:23.114186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f31c11-2b35-4e86-a138-d513193dbfce None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:23.171704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:23.172304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.172581 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.172850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.173479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:23.175381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:23.197912 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1395/2764] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:23 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:23.201490 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:23.211769 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0720-1c75-4687-aeb3-3c2100e0f030 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:23.216896 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:23.217483 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.217756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.218069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.218717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:23.220320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:23.231473 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1370/2765] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:23.236027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:23.245715 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777922bd-0978-4f42-a4f3-a248f4c1987a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:23.250266 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:23.250901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.251176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.251475 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] PATH_INFO: `/v3/projects/888bba150c654023aa812e0d90d70fc8/users/7996a9c95b7a4830a8b525b76735efb3/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.265841 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888bba150c654023aa812e0d90d70fc8, user_id=7996a9c95b7a4830a8b525b76735efb3, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:23.268444 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:23.281552 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1396/2766] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:23 2022] PUT /identity/v3/projects/888bba150c654023aa812e0d90d70fc8/users/7996a9c95b7a4830a8b525b76735efb3/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:23.285539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:23.296113 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5862d55-c1f6-4f5e-89f6-76b19f86ebc0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:23.351077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa3ac-34e8-4d81-837d-685a47dc2e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:23.351704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa3ac-34e8-4d81-837d-685a47dc2e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.351985 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa3ac-34e8-4d81-837d-685a47dc2e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.352256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa3ac-34e8-4d81-837d-685a47dc2e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.352888 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa3ac-34e8-4d81-837d-685a47dc2e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:23.354484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa3ac-34e8-4d81-837d-685a47dc2e9c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:23.364433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1371/2767] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:23.368606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:23.378814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215639be-db01-4575-b2d9-34b60830c997 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:23.383766 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:23.384420 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.384701 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.384972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] PATH_INFO: `/v3/projects/888bba150c654023aa812e0d90d70fc8/users/7996a9c95b7a4830a8b525b76735efb3/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.386949 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888bba150c654023aa812e0d90d70fc8, user_id=7996a9c95b7a4830a8b525b76735efb3, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:23.389759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:23.399960 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1397/2768] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:23 2022] PUT /identity/v3/projects/888bba150c654023aa812e0d90d70fc8/users/7996a9c95b7a4830a8b525b76735efb3/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:23.411570 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6e1c-8534-4d2b-b7dc-fb2e02eaa927 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.412070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6e1c-8534-4d2b-b7dc-fb2e02eaa927 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.412199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6e1c-8534-4d2b-b7dc-fb2e02eaa927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.440002 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-469a6e1c-8534-4d2b-b7dc-fb2e02eaa927 None None] MFA Rules not processed for user `7996a9c95b7a4830a8b525b76735efb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:23.441211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-469a6e1c-8534-4d2b-b7dc-fb2e02eaa927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:23.473258 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:23.510018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1372/2769] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:21:23.521294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:23.522999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:23.538010 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:23.582629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0a62d-2a31-431b-9c89-2eda129ed257 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:23.586287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524988e-1bd7-4116-9688-6190cb22d9c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:23.586877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524988e-1bd7-4116-9688-6190cb22d9c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:23.587157 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524988e-1bd7-4116-9688-6190cb22d9c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:23.587433 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524988e-1bd7-4116-9688-6190cb22d9c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:23.597305 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524988e-1bd7-4116-9688-6190cb22d9c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:23.598724 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524988e-1bd7-4116-9688-6190cb22d9c8 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:23.608622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1398/2770] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:24.927793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a6e1c-8534-4d2b-b7dc-fb2e02eaa927 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:24.989493 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a6e1c-8534-4d2b-b7dc-fb2e02eaa927 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:24.993936 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:24.994549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:24.994825 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:24.995096 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] PATH_INFO: `/v3/users/86581b9ff2bc48bebb09bacc3b49f3a4` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:24.996271 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86581b9ff2bc48bebb09bacc3b49f3a4)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:24.998179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:25.044485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86581b9ff2bc48bebb09bacc3b49f3a4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.056221 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86581b9ff2bc48bebb09bacc3b49f3a4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.063288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86581b9ff2bc48bebb09bacc3b49f3a4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.063973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86581b9ff2bc48bebb09bacc3b49f3a4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.064575 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86581b9ff2bc48bebb09bacc3b49f3a4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.077404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1373/2771] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:24 2022] DELETE /identity/v3/users/86581b9ff2bc48bebb09bacc3b49f3a4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:25.081832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:25.082340 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:25.082522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:25.101479 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:25.102674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:25.161249 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1399/2772] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:25.171076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:25.172516 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:25.226165 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:25.231051 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0aa6a-2b08-4718-96e0-c4942e6eb3a5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:25.235556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:25.236166 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:25.236798 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:25.237176 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:25.246765 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:25.248230 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:25.257764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1374/2773] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:25.528810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:25.530345 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:25.543128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a32c-e5b0-4b18-b487-0314f971fbfb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:25.547801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:25.548437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:25.548711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:25.548983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] PATH_INFO: `/v3/projects/b40f3c26241b4719a1a92fb897f7bdf9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:25.550116 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40f3c26241b4719a1a92fb897f7bdf9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:25.552119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:25.599136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40f3c26241b4719a1a92fb897f7bdf9', 'request_id': 'req-3a63b995-f104-4861-b816-ad625699463a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.605370 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40f3c26241b4719a1a92fb897f7bdf9', 'request_id': 'req-3a63b995-f104-4861-b816-ad625699463a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.610793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40f3c26241b4719a1a92fb897f7bdf9', 'request_id': 'req-3a63b995-f104-4861-b816-ad625699463a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.623598 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] The token cache is being invalidate because project b40f3c26241b4719a1a92fb897f7bdf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:25.623901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.624544 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.626189 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1400/2774] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:25 2022] DELETE /identity/v3/projects/b40f3c26241b4719a1a92fb897f7bdf9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:25.630192 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:25.640293 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda8105-eae8-43aa-871a-5bf52382c2e6 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:25.695196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:25.695842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:25.696112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:25.696374 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] PATH_INFO: `/v3/users/7996a9c95b7a4830a8b525b76735efb3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:25.697495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7996a9c95b7a4830a8b525b76735efb3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:25.700077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:25.744349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7996a9c95b7a4830a8b525b76735efb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.756552 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7996a9c95b7a4830a8b525b76735efb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.763823 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7996a9c95b7a4830a8b525b76735efb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.764484 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7996a9c95b7a4830a8b525b76735efb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.765109 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0d431604-23e4-431a-b86b-e5817862fc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7996a9c95b7a4830a8b525b76735efb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:25.777383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1375/2775] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:25 2022] DELETE /identity/v3/users/7996a9c95b7a4830a8b525b76735efb3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:26.059158 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.061159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:26.076093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63b995-f104-4861-b816-ad625699463a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.111867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:26.137648 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.138199 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.138473 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.138742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] PATH_INFO: `/v3/projects/888bba150c654023aa812e0d90d70fc8` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.139873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] RBAC: Authorizing `identity:delete_project(project_id=888bba150c654023aa812e0d90d70fc8)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.141759 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.186590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888bba150c654023aa812e0d90d70fc8', 'request_id': 'req-7af8c760-0e8d-4d11-98be-ae2a344cd53c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:26.192689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888bba150c654023aa812e0d90d70fc8', 'request_id': 'req-7af8c760-0e8d-4d11-98be-ae2a344cd53c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:26.198101 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888bba150c654023aa812e0d90d70fc8', 'request_id': 'req-7af8c760-0e8d-4d11-98be-ae2a344cd53c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:26.209970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] The token cache is being invalidate because project 888bba150c654023aa812e0d90d70fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:26.210252 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:26.210863 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7af8c760-0e8d-4d11-98be-ae2a344cd53c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:26.212689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1401/2776] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:26 2022] DELETE /identity/v3/projects/888bba150c654023aa812e0d90d70fc8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:26.218063 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab55325-af60-4fb2-9dda-916d73b59d3e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.218557 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab55325-af60-4fb2-9dda-916d73b59d3e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.218674 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab55325-af60-4fb2-9dda-916d73b59d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.238239 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5ab55325-af60-4fb2-9dda-916d73b59d3e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:26.239436 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5ab55325-af60-4fb2-9dda-916d73b59d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:26.296944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1376/2777] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:26.305155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060bc2-aff0-4fdb-ae32-f943a1ca97a5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.305155 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060bc2-aff0-4fdb-ae32-f943a1ca97a5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.305421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060bc2-aff0-4fdb-ae32-f943a1ca97a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.326269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a4060bc2-aff0-4fdb-ae32-f943a1ca97a5 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:26.327497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a4060bc2-aff0-4fdb-ae32-f943a1ca97a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:26.335293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1402/2778] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:26.339435 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab55325-af60-4fb2-9dda-916d73b59d3e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.348967 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab55325-af60-4fb2-9dda-916d73b59d3e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.353489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.354080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.354364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.354634 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.355268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:26.355621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.357332 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.363861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:26.369704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1377/2779] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:26.374187 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4060bc2-aff0-4fdb-ae32-f943a1ca97a5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.383315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4060bc2-aff0-4fdb-ae32-f943a1ca97a5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.389314 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.389850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.390141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.390389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.391013 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.392925 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.419966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1403/2780] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:26 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:21:26.424172 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.434872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78960618-1dec-4fbc-85ac-5ac7e81feff8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.490349 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.490942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.491215 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.491511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.492130 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.494057 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.515778 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1378/2781] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:26 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:21:26.520024 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.530633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9319-3c2a-4a6a-ab9c-28b31aff15d7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.535250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.535876 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.536152 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.536417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.537046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.538604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.549206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1404/2782] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:26.553075 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.563756 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761478-8cb5-49e5-969f-0b288830fb46 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.568286 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569df22-ecaf-4cf9-bc0c-a71f14544e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.568872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569df22-ecaf-4cf9-bc0c-a71f14544e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.569147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569df22-ecaf-4cf9-bc0c-a71f14544e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.569415 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569df22-ecaf-4cf9-bc0c-a71f14544e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.570052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569df22-ecaf-4cf9-bc0c-a71f14544e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.571695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569df22-ecaf-4cf9-bc0c-a71f14544e12 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.581909 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1379/2783] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:26.585882 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.595934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e7458-3c5e-492c-9661-9e5674e3b684 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.600519 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.601160 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.601438 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.601713 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] PATH_INFO: `/v3/projects/6fc3706c2fcc417b9d183f7af9a5e5fd/users/5a9dea398f1e4bbf8b8c68c81ef9b2ef/roles/e606be389f29465393427b1abb34b098` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.617862 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc3706c2fcc417b9d183f7af9a5e5fd, user_id=5a9dea398f1e4bbf8b8c68c81ef9b2ef, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.620600 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.634347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1405/2784] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:26 2022] PUT /identity/v3/projects/6fc3706c2fcc417b9d183f7af9a5e5fd/users/5a9dea398f1e4bbf8b8c68c81ef9b2ef/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:26.645636 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa0ca-6f2e-4d82-8683-c57b1f56b751 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.645862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa0ca-6f2e-4d82-8683-c57b1f56b751 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.646135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa0ca-6f2e-4d82-8683-c57b1f56b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.674357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-889aa0ca-6f2e-4d82-8683-c57b1f56b751 None None] MFA Rules not processed for user `5a9dea398f1e4bbf8b8c68c81ef9b2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:26.675606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-889aa0ca-6f2e-4d82-8683-c57b1f56b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:26.739922 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1380/2785] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:26.744492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.804832 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312728c6-bf57-4f34-a3f3-39e7ad2fca83 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.809397 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.809985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.810265 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.810530 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.811137 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.813310 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.822535 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:26.841753 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1406/2786] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:26 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:26.845772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa0ca-6f2e-4d82-8683-c57b1f56b751 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.856333 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa0ca-6f2e-4d82-8683-c57b1f56b751 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.911646 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.912162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.912433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.912699 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.913304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.915196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.925995 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:26.938678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1381/2787] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:26 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:26.942696 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.953825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5998d71-9a97-4dee-a289-a027035043dd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.958451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.959048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.959325 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.959635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:26.960541 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:26.962125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:26.972054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1407/2788] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:26.976097 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:26.986003 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3469ca-1697-4085-a913-fe65775b32de admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:26.990542 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:26.991191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:26.991498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:26.991772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] PATH_INFO: `/v3/projects/262bfd8e1d894e82a0684638f30d438d/users/aff270156d9149a8a3bf8d11877f98c6/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.007791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] RBAC: Authorizing `identity:create_grant(project_id=262bfd8e1d894e82a0684638f30d438d, user_id=aff270156d9149a8a3bf8d11877f98c6, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.010447 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.024117 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1382/2789] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:26 2022] PUT /identity/v3/projects/262bfd8e1d894e82a0684638f30d438d/users/aff270156d9149a8a3bf8d11877f98c6/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:21:27.028075 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:27.038042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420fc6c-0e1f-490f-98ac-4c2f4b34b49d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:27.093531 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d0669-2629-434e-b7f7-4c27bd3ddcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:27.094130 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d0669-2629-434e-b7f7-4c27bd3ddcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.094408 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d0669-2629-434e-b7f7-4c27bd3ddcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.094677 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d0669-2629-434e-b7f7-4c27bd3ddcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.095308 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d0669-2629-434e-b7f7-4c27bd3ddcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.096929 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d0669-2629-434e-b7f7-4c27bd3ddcb5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.106568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1408/2790] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:27.110645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:27.121708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24807410-f9eb-4e1a-98f4-4e73e578084a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:27.126339 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:27.126980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.127255 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.127568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] PATH_INFO: `/v3/projects/262bfd8e1d894e82a0684638f30d438d/users/aff270156d9149a8a3bf8d11877f98c6/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.129489 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262bfd8e1d894e82a0684638f30d438d, user_id=aff270156d9149a8a3bf8d11877f98c6, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.132152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.142762 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1383/2791] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:27 2022] PUT /identity/v3/projects/262bfd8e1d894e82a0684638f30d438d/users/aff270156d9149a8a3bf8d11877f98c6/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:27.205246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ccef-d361-4b61-8383-eaa74e6d4018 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.205810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ccef-d361-4b61-8383-eaa74e6d4018 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.205810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ccef-d361-4b61-8383-eaa74e6d4018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.234441 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9787ccef-d361-4b61-8383-eaa74e6d4018 None None] MFA Rules not processed for user `aff270156d9149a8a3bf8d11877f98c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:27.235689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9787ccef-d361-4b61-8383-eaa74e6d4018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:27.308025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1409/2792] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:27.320828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:27.322540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:27.379619 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e970ee-f2c1-43a0-b9e5-aa8c0e8ea4f8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:27.383248 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:27.383873 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.384150 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.384423 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.393939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.395364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.405304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1384/2793] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:27.706625 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ccef-d361-4b61-8383-eaa74e6d4018 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:27.716264 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ccef-d361-4b61-8383-eaa74e6d4018 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:27.720886 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff270156d9149a8a3bf8d11877f98c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262bfd8e1d894e82a0684638f30d438d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:27.721481 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.721816 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.722103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.722748 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:27.723055 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.724730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.738462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1410/2794] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:27.742809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:27.752076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d19c-e431-4448-9cfa-a85488dd891f service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:27.756710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff270156d9149a8a3bf8d11877f98c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262bfd8e1d894e82a0684638f30d438d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:27.757298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.757579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.757852 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.758467 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.760395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.787111 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1385/2795] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:27 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:27.791241 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:27.801813 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02038b8-1b33-424b-8d4e-ac95648d8895 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:27.849596 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:27.863774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff270156d9149a8a3bf8d11877f98c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262bfd8e1d894e82a0684638f30d438d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:27.864374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.864651 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.864923 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.865558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:27.865860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.867488 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.879792 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1411/2796] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:27.916385 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:27.927123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2856c-557b-426e-8940-7c28f1b25717 tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:27.931667 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff270156d9149a8a3bf8d11877f98c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262bfd8e1d894e82a0684638f30d438d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:27.932283 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:27.932563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:27.932834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] PATH_INFO: `/v3/projects/52cca8fe5dd647dd8f61708d8ba6120b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:27.934174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52cca8fe5dd647dd8f61708d8ba6120b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:27.936110 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:27.982362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cca8fe5dd647dd8f61708d8ba6120b', 'request_id': 'req-8fca686d-4ef0-42b7-8e55-f22858f0a26d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:27.989652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cca8fe5dd647dd8f61708d8ba6120b', 'request_id': 'req-8fca686d-4ef0-42b7-8e55-f22858f0a26d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:27.995194 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cca8fe5dd647dd8f61708d8ba6120b', 'request_id': 'req-8fca686d-4ef0-42b7-8e55-f22858f0a26d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.006424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] The token cache is being invalidate because project 52cca8fe5dd647dd8f61708d8ba6120b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:28.006708 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.007353 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fca686d-4ef0-42b7-8e55-f22858f0a26d tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.008860 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1386/2797] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:27 2022] DELETE /identity/v3/projects/52cca8fe5dd647dd8f61708d8ba6120b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:28.199852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:28.201738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:28.267629 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb63d-d709-4334-9924-f28b60fc972c tempest-VolumeQuotaClassesTest-277415689 tempest-VolumeQuotaClassesTest-277415689-project-admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:28.323037 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:28.323707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:28.324525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:28.324972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] PATH_INFO: `/v3/users/5a9dea398f1e4bbf8b8c68c81ef9b2ef` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:28.326203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9dea398f1e4bbf8b8c68c81ef9b2ef)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:28.328165 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:28.373829 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9dea398f1e4bbf8b8c68c81ef9b2ef'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.374472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9dea398f1e4bbf8b8c68c81ef9b2ef'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.385944 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9dea398f1e4bbf8b8c68c81ef9b2ef'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.387224 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9dea398f1e4bbf8b8c68c81ef9b2ef'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.393806 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9dea398f1e4bbf8b8c68c81ef9b2ef'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.407063 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1412/2798] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:28 2022] DELETE /identity/v3/users/5a9dea398f1e4bbf8b8c68c81ef9b2ef => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:28.411723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:28.412199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:28.412301 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:28.430872 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:28.432098 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:28.450492 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:28.492595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1387/2799] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:28.502786 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:28.504216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:28.514571 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:28.562700 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476fce6-2909-4ce0-8b0f-f5c1c03f3646 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:28.566363 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:28.566955 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:28.567228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:28.567522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:28.576559 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:28.578018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:28.587451 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1413/2800] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:28.850834 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:28.852302 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:28.865644 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b4b47-c81d-4b9b-b778-43d8d5dd542d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:28.870173 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:28.870832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:28.871908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:28.872736 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] PATH_INFO: `/v3/projects/6fc3706c2fcc417b9d183f7af9a5e5fd` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:28.873405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc3706c2fcc417b9d183f7af9a5e5fd)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:28.875243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:28.921433 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc3706c2fcc417b9d183f7af9a5e5fd', 'request_id': 'req-86eae25f-e93d-4f48-919f-710297e798ec'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.929839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc3706c2fcc417b9d183f7af9a5e5fd', 'request_id': 'req-86eae25f-e93d-4f48-919f-710297e798ec'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.936384 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc3706c2fcc417b9d183f7af9a5e5fd', 'request_id': 'req-86eae25f-e93d-4f48-919f-710297e798ec'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.947626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] The token cache is being invalidate because project 6fc3706c2fcc417b9d183f7af9a5e5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:28.947939 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.948565 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:28.950738 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1388/2801] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:28 2022] DELETE /identity/v3/projects/6fc3706c2fcc417b9d183f7af9a5e5fd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:28.954823 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:28.965299 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072ae93-a3e0-4a33-86eb-542f4220f83b service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.019324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.019988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.020295 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.020567 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] PATH_INFO: `/v3/users/aff270156d9149a8a3bf8d11877f98c6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.021710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff270156d9149a8a3bf8d11877f98c6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.023756 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.068612 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff270156d9149a8a3bf8d11877f98c6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.069242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff270156d9149a8a3bf8d11877f98c6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.081779 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff270156d9149a8a3bf8d11877f98c6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.082394 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff270156d9149a8a3bf8d11877f98c6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.088987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-095cb74a-95c6-40db-944c-f5fb39ee46e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff270156d9149a8a3bf8d11877f98c6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.102017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1414/2802] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:28 2022] DELETE /identity/v3/users/aff270156d9149a8a3bf8d11877f98c6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:29.378715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:29.380396 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:29.398949 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae25f-e93d-4f48-919f-710297e798ec admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.459614 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.460315 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.460498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.460767 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] PATH_INFO: `/v3/projects/262bfd8e1d894e82a0684638f30d438d` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.461883 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] RBAC: Authorizing `identity:delete_project(project_id=262bfd8e1d894e82a0684638f30d438d)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.463821 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.508701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:29.509928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262bfd8e1d894e82a0684638f30d438d', 'request_id': 'req-bfe3f726-1048-477b-90e0-c9f4a0e7405c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.519038 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262bfd8e1d894e82a0684638f30d438d', 'request_id': 'req-bfe3f726-1048-477b-90e0-c9f4a0e7405c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.529304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262bfd8e1d894e82a0684638f30d438d', 'request_id': 'req-bfe3f726-1048-477b-90e0-c9f4a0e7405c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.540540 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] The token cache is being invalidate because project 262bfd8e1d894e82a0684638f30d438d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:29.541105 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.541748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfe3f726-1048-477b-90e0-c9f4a0e7405c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:29.543266 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1389/2803] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:29 2022] DELETE /identity/v3/projects/262bfd8e1d894e82a0684638f30d438d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:29.548223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9e5e-f810-40e9-8f3d-95bfa7b56275 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.548749 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9e5e-f810-40e9-8f3d-95bfa7b56275 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.548854 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9e5e-f810-40e9-8f3d-95bfa7b56275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.568029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d5ef9e5e-f810-40e9-8f3d-95bfa7b56275 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:29.569228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d5ef9e5e-f810-40e9-8f3d-95bfa7b56275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:29.594161 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:29.632294 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1415/2804] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:29.640641 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8915ae7-6010-405c-b01d-81e2552be443 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.640921 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8915ae7-6010-405c-b01d-81e2552be443 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.641198 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8915ae7-6010-405c-b01d-81e2552be443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.661502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b8915ae7-6010-405c-b01d-81e2552be443 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:29.662742 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b8915ae7-6010-405c-b01d-81e2552be443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:29.670689 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1390/2805] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:29.675108 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9e5e-f810-40e9-8f3d-95bfa7b56275 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:29.685028 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9e5e-f810-40e9-8f3d-95bfa7b56275 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.689932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.690619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.690962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.691293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.692021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:29.692384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.694016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.706537 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1416/2806] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:29.710928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8915ae7-6010-405c-b01d-81e2552be443 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:29.720951 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8915ae7-6010-405c-b01d-81e2552be443 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.725539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.726127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.726401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.726666 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.727288 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.729207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.754957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1391/2807] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:29 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:29.759321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:29.769685 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5473ac4-955e-4c3a-a09f-8aea0424f36f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.830203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.830815 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.831083 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.831379 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.832047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.833956 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.857436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1417/2808] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:29 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:29.861185 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:29.871298 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db423a-a56b-4bac-a835-096f427d0c6a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.875974 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.876564 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.876835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.877101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.877735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.879343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.889950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1392/2809] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:29.893940 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:29.904551 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dda96-e8dd-41b1-aee9-59d27ee1d7d9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.909204 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0e287-c54f-4e07-8255-f205ff8bfcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.909801 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0e287-c54f-4e07-8255-f205ff8bfcae admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.910078 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0e287-c54f-4e07-8255-f205ff8bfcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.910349 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0e287-c54f-4e07-8255-f205ff8bfcae admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.910993 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0e287-c54f-4e07-8255-f205ff8bfcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.912605 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0e287-c54f-4e07-8255-f205ff8bfcae admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.923011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1418/2810] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:29.927030 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:29.937661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bbcca-ad5c-44e4-b8c7-c8d46a2e4e47 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:29.942155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:29.942835 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.943135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.943505 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] PATH_INFO: `/v3/projects/4ce1559934034b619983995ef9661034/users/3d07c0e431524c67ae2ec964dfa9c3b8/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:29.959710 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce1559934034b619983995ef9661034, user_id=3d07c0e431524c67ae2ec964dfa9c3b8, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:29.962377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:29.975155 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1393/2811] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:29 2022] PUT /identity/v3/projects/4ce1559934034b619983995ef9661034/users/3d07c0e431524c67ae2ec964dfa9c3b8/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:29.981047 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754cb44-f6e8-40a1-af67-c0c896ca075b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:29.981330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754cb44-f6e8-40a1-af67-c0c896ca075b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:29.981604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754cb44-f6e8-40a1-af67-c0c896ca075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:30.000297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c754cb44-f6e8-40a1-af67-c0c896ca075b None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:30.001485 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c754cb44-f6e8-40a1-af67-c0c896ca075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:30.059641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1419/2812] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:30.069652 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:30.071338 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:30.128180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf22f07-7082-49ab-9d81-16e991bbf6ce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:30.131776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:30.132377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:30.132645 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:30.132913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:30.141665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:30.143024 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:30.152637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1394/2813] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:30.774994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63042a1-1d26-49e9-9182-bdf9a016001a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:30.775623 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63042a1-1d26-49e9-9182-bdf9a016001a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:30.775742 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63042a1-1d26-49e9-9182-bdf9a016001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:30.804568 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c63042a1-1d26-49e9-9182-bdf9a016001a None None] MFA Rules not processed for user `3d07c0e431524c67ae2ec964dfa9c3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:30.805793 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c63042a1-1d26-49e9-9182-bdf9a016001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:30.832003 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:30.879303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1420/2814] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:30.883919 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:30.894145 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9db8-1067-4152-b7a0-5e6e9bd06cba service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:30.898590 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:30.899177 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:30.899478 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:30.899748 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:30.900359 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:30.902284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:30.929968 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1395/2815] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:30 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:30.934825 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63042a1-1d26-49e9-9182-bdf9a016001a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:30.945861 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63042a1-1d26-49e9-9182-bdf9a016001a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:31.000652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:31.001176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:31.001450 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:31.001719 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:31.002330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:31.004253 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:31.025846 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1421/2816] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:30 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:31.029867 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:31.040031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eb254-ccb6-4b02-801d-32f7d8b7165d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:31.045160 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:31.045760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:31.046018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:31.046281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:31.046908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:31.048519 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:31.059234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1396/2817] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:31.063490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:31.073604 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930efd-93ab-4afb-89a8-b4d596c2d65e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:31.078284 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:31.078921 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:31.079203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:31.079507 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] PATH_INFO: `/v3/projects/d0bceb31d2c0472986aa6ede4f2c862b/users/0952ceb4d67545cb937f7007f8d5eac6/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:31.093938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bceb31d2c0472986aa6ede4f2c862b, user_id=0952ceb4d67545cb937f7007f8d5eac6, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:31.096618 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:31.109707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1422/2818] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:31 2022] PUT /identity/v3/projects/d0bceb31d2c0472986aa6ede4f2c862b/users/0952ceb4d67545cb937f7007f8d5eac6/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:21:31.113617 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:31.124550 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66213f19-e2d9-4191-a37a-e0452b88b8a5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:31.162453 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:31.179942 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e0ca9-61c2-494e-b38f-d3bb1970d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:31.180535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e0ca9-61c2-494e-b38f-d3bb1970d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:31.180809 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e0ca9-61c2-494e-b38f-d3bb1970d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:31.181076 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e0ca9-61c2-494e-b38f-d3bb1970d2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:31.181701 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e0ca9-61c2-494e-b38f-d3bb1970d2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:31.183980 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e0ca9-61c2-494e-b38f-d3bb1970d2bd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:31.193578 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1397/2819] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:31.197757 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:31.208348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884f183-0c91-49bc-a9da-424aaf81727d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:31.212859 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:31.213501 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:31.213775 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:31.214043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] PATH_INFO: `/v3/projects/d0bceb31d2c0472986aa6ede4f2c862b/users/0952ceb4d67545cb937f7007f8d5eac6/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:31.216052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bceb31d2c0472986aa6ede4f2c862b, user_id=0952ceb4d67545cb937f7007f8d5eac6, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:31.218683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:31.228674 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1423/2820] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:31 2022] PUT /identity/v3/projects/d0bceb31d2c0472986aa6ede4f2c862b/users/0952ceb4d67545cb937f7007f8d5eac6/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:31.862760 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:31.863070 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:31.863343 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:31.892913 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] MFA Rules not processed for user `0952ceb4d67545cb937f7007f8d5eac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:31.894138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:31.968908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1398/2821] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:31.976620 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:31.978355 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:32.040456 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf3a49-62f2-4728-89bd-821c7eaf7729 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:32.044330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:32.044934 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:32.045216 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:32.045492 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:32.076044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:32.103048 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:32.104514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:32.113268 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1424/2822] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:33.470250 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:33.471663 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:33.484191 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8038481-0d8c-4cd8-9800-40dfba5d1c2a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:33.487711 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:33.488303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:33.488606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:33.488905 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:33.497924 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:33.499362 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:33.508793 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1399/2823] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:42.109350 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=13 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:43.504715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=50 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:46.641633 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:46.704743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4093e2-1546-4c75-a395-9956c4c1961c service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:46.709173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:46.709787 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:46.710059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:46.710324 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] PATH_INFO: `/v3/users/3d07c0e431524c67ae2ec964dfa9c3b8` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:46.711462 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d07c0e431524c67ae2ec964dfa9c3b8)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:46.713352 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:46.758417 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d07c0e431524c67ae2ec964dfa9c3b8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:46.759087 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d07c0e431524c67ae2ec964dfa9c3b8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:46.771401 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d07c0e431524c67ae2ec964dfa9c3b8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:46.772032 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d07c0e431524c67ae2ec964dfa9c3b8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:46.779287 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d07c0e431524c67ae2ec964dfa9c3b8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:46.791374 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1425/2824] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:46 2022] DELETE /identity/v3/users/3d07c0e431524c67ae2ec964dfa9c3b8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:46.958791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:46.970238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21e47-c47e-474d-a78b-67d336c982f4 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.025378 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.025993 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.026267 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.026535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] PATH_INFO: `/v3/projects/4ce1559934034b619983995ef9661034` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.028427 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce1559934034b619983995ef9661034)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.030310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.075789 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce1559934034b619983995ef9661034', 'request_id': 'req-d7ac6f29-df71-423b-abb1-af1016ab38a8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.083064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce1559934034b619983995ef9661034', 'request_id': 'req-d7ac6f29-df71-423b-abb1-af1016ab38a8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.088678 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce1559934034b619983995ef9661034', 'request_id': 'req-d7ac6f29-df71-423b-abb1-af1016ab38a8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.100219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] The token cache is being invalidate because project 4ce1559934034b619983995ef9661034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:47.100507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.101131 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.102602 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1400/2825] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:46 2022] DELETE /identity/v3/projects/4ce1559934034b619983995ef9661034 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:21:47.107041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:47.108516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:47.122707 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5827718-1f0c-4107-a3e7-94d7df354356 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.179128 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.179782 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.180059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.180330 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] PATH_INFO: `/v3/users/0952ceb4d67545cb937f7007f8d5eac6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.181431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0952ceb4d67545cb937f7007f8d5eac6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.183365 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.204606 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:47.230278 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0952ceb4d67545cb937f7007f8d5eac6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.231734 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0952ceb4d67545cb937f7007f8d5eac6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.243426 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0952ceb4d67545cb937f7007f8d5eac6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.244092 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0952ceb4d67545cb937f7007f8d5eac6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.251331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-abafeb92-032d-4f87-a00d-818000d053db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0952ceb4d67545cb937f7007f8d5eac6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.264652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1426/2826] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:47 2022] DELETE /identity/v3/users/0952ceb4d67545cb937f7007f8d5eac6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:47.440733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:47.442149 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:47.458256 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6f29-df71-423b-abb1-af1016ab38a8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.516925 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.517547 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.517824 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.518095 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] PATH_INFO: `/v3/projects/d0bceb31d2c0472986aa6ede4f2c862b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.519206 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bceb31d2c0472986aa6ede4f2c862b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.521152 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.555323 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:47.570424 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bceb31d2c0472986aa6ede4f2c862b', 'request_id': 'req-79463129-20a2-445b-b77c-a4739485a7a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.577743 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bceb31d2c0472986aa6ede4f2c862b', 'request_id': 'req-79463129-20a2-445b-b77c-a4739485a7a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.583648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bceb31d2c0472986aa6ede4f2c862b', 'request_id': 'req-79463129-20a2-445b-b77c-a4739485a7a9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.594405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] The token cache is being invalidate because project d0bceb31d2c0472986aa6ede4f2c862b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:47.594694 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.595327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79463129-20a2-445b-b77c-a4739485a7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:47.596812 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1401/2827] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:47 2022] DELETE /identity/v3/projects/d0bceb31d2c0472986aa6ede4f2c862b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:47.601683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380ec35-d014-45ba-afc5-a8076f327e77 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.601966 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380ec35-d014-45ba-afc5-a8076f327e77 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.602236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380ec35-d014-45ba-afc5-a8076f327e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.626323 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f380ec35-d014-45ba-afc5-a8076f327e77 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:47.627580 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f380ec35-d014-45ba-afc5-a8076f327e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:47.691547 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1427/2828] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:47.700755 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c6ca-739b-49ae-9f68-9a4beead16cb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.701035 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c6ca-739b-49ae-9f68-9a4beead16cb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.701449 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c6ca-739b-49ae-9f68-9a4beead16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.720607 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b805c6ca-739b-49ae-9f68-9a4beead16cb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:47.722132 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b805c6ca-739b-49ae-9f68-9a4beead16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:47.730196 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1402/2829] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:47.734951 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380ec35-d014-45ba-afc5-a8076f327e77 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:47.744586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380ec35-d014-45ba-afc5-a8076f327e77 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.749741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.750339 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.750641 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.750919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.751716 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:47.752025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.753609 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.765103 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1428/2830] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:47.769234 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c6ca-739b-49ae-9f68-9a4beead16cb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:47.778277 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c6ca-739b-49ae-9f68-9a4beead16cb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.782864 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.783474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.783754 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.784022 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.784637 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.786518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.813459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1403/2831] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:47 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:47.817584 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:47.828236 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd9f8d-42a0-41f5-a47a-7dc355cc8a5e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.885188 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.885722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.885999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.886272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.887376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.889298 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.912525 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1429/2832] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:47 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:47.917600 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:47.928775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfccf07-2a9e-4ae4-a1c7-4cdbe2e22156 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.933417 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.934064 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.934336 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.934618 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.935284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.936900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.947243 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1404/2833] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:47.951998 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:47.964421 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14266890-3aea-492e-bd4e-ddccc39bad59 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:47.970811 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b4534-7082-43ca-80b3-e587847c573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:47.971460 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b4534-7082-43ca-80b3-e587847c573b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:47.971743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b4534-7082-43ca-80b3-e587847c573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:47.972015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b4534-7082-43ca-80b3-e587847c573b admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:47.972654 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b4534-7082-43ca-80b3-e587847c573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:47.974250 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b4534-7082-43ca-80b3-e587847c573b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:47.985608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1430/2834] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:47.990238 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.001011 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f41996-ba10-4c97-b158-cd6bbe95ebac admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.006276 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.006955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.007232 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.007739 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] PATH_INFO: `/v3/projects/bfb4071b1dd94f338bd3c0c5c30de19a/users/94ef2905f982440d921e5da86ebcafbf/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.023555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb4071b1dd94f338bd3c0c5c30de19a, user_id=94ef2905f982440d921e5da86ebcafbf, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.026204 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.039372 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1405/2835] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:47 2022] PUT /identity/v3/projects/bfb4071b1dd94f338bd3c0c5c30de19a/users/94ef2905f982440d921e5da86ebcafbf/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:48.049842 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c968-455a-447f-939b-3316319cf81d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.050125 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c968-455a-447f-939b-3316319cf81d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.050412 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c968-455a-447f-939b-3316319cf81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.058986 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:48.080814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5384c968-455a-447f-939b-3316319cf81d None None] MFA Rules not processed for user `94ef2905f982440d921e5da86ebcafbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:48.082009 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5384c968-455a-447f-939b-3316319cf81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:48.146774 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1431/2836] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:48.151123 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.210903 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492500db-1b82-452d-a0d4-318dbca6cb81 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.217658 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.218606 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.218884 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.219148 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.219802 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.221693 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.249944 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1406/2837] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:48 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:48.254141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384c968-455a-447f-939b-3316319cf81d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.265691 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384c968-455a-447f-939b-3316319cf81d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.321526 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.322139 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.322419 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.322688 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.323313 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.325590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.346154 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1432/2838] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:48 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:21:48.350548 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.361405 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb8d43-d595-4f55-9d52-73b6a0ac87bf admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.365950 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.366541 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.366816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.367085 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.367759 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.369331 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.380304 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1407/2839] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:48.384331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.394442 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb927a1-4671-4d2e-851e-babe002fd3e4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.399119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.399732 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.400011 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.400286 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] PATH_INFO: `/v3/projects/dd50a59c54544b798ed78f242deba2e1/users/f7bae2badc134191817cda7ad6b47c12/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.414669 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd50a59c54544b798ed78f242deba2e1, user_id=f7bae2badc134191817cda7ad6b47c12, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.417422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.430722 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1433/2840] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:48 2022] PUT /identity/v3/projects/dd50a59c54544b798ed78f242deba2e1/users/f7bae2badc134191817cda7ad6b47c12/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:48.435296 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.445257 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5c519-d338-41d8-8a72-3bb95b577588 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.473434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:48.504312 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a09411-5541-410d-b09e-a524da15b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.504906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a09411-5541-410d-b09e-a524da15b251 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.505181 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a09411-5541-410d-b09e-a524da15b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.505446 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a09411-5541-410d-b09e-a524da15b251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.506077 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a09411-5541-410d-b09e-a524da15b251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.507695 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a09411-5541-410d-b09e-a524da15b251 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.517434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1408/2841] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:21:48.521522 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.531684 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5629f-315d-4ae2-ae3b-a11740e31fc4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.536210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.536844 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.537120 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.537389 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] PATH_INFO: `/v3/projects/dd50a59c54544b798ed78f242deba2e1/users/f7bae2badc134191817cda7ad6b47c12/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.539262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd50a59c54544b798ed78f242deba2e1, user_id=f7bae2badc134191817cda7ad6b47c12, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.541909 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.552384 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1434/2842] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:48 2022] PUT /identity/v3/projects/dd50a59c54544b798ed78f242deba2e1/users/f7bae2badc134191817cda7ad6b47c12/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:48.563752 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.564031 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.564327 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.591488 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] MFA Rules not processed for user `f7bae2badc134191817cda7ad6b47c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:48.592698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:48.670737 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1409/2843] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:48.681186 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:48.682871 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:48.735035 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:48.741054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258517-2f5c-4539-80ef-4ce9acf496b9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:48.744901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:48.745491 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:48.745762 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:48.746643 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:48.800851 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:48.802269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:48.811692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1435/2844] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:53.019855 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:53.021268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:53.033507 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014fd4c-30db-488d-9384-f8e79e8e75ae None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:53.037026 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5694c-a10a-46fa-a8f1-0cb16f5b343a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3812df0dc174249acb139876f4302ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:53.037621 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5694c-a10a-46fa-a8f1-0cb16f5b343a service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:53.037894 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5694c-a10a-46fa-a8f1-0cb16f5b343a service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:53.038159 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5694c-a10a-46fa-a8f1-0cb16f5b343a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:53.047594 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5694c-a10a-46fa-a8f1-0cb16f5b343a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:53.049014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5694c-a10a-46fa-a8f1-0cb16f5b343a service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:53.058282 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1410/2845] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:57.934381 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:57.998393 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafbd9a-8a2d-4490-994e-d1abe8f0432a service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:58.002807 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:58.003431 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:58.003720 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:58.003989 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] PATH_INFO: `/v3/users/94ef2905f982440d921e5da86ebcafbf` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:58.005109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ef2905f982440d921e5da86ebcafbf)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:58.006999 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:58.052458 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ef2905f982440d921e5da86ebcafbf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.053106 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ef2905f982440d921e5da86ebcafbf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.065317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ef2905f982440d921e5da86ebcafbf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.065954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ef2905f982440d921e5da86ebcafbf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.072687 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ef2905f982440d921e5da86ebcafbf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.085653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1436/2846] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:57 2022] DELETE /identity/v3/users/94ef2905f982440d921e5da86ebcafbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:58.090841 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:58.091329 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:58.091476 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:58.109500 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:58.110675 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:58.170161 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1411/2847] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:58.180429 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:58.181857 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:58.204889 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:58.242824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f140e-a3a8-488d-a3c3-68fbd91758d1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:58.246714 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:58.247312 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:58.247611 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:58.247879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:58.256583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:58.257987 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:58.267945 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1437/2848] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:21:58.534120 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:58.535774 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:58.549583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82085e4b-6a5b-405b-a129-fb04a374b593 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:58.554179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:58.554806 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:58.555080 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:58.555354 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] PATH_INFO: `/v3/projects/bfb4071b1dd94f338bd3c0c5c30de19a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:58.556509 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb4071b1dd94f338bd3c0c5c30de19a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:58.559391 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:58.598268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:58.609375 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb4071b1dd94f338bd3c0c5c30de19a', 'request_id': 'req-f766df0c-8281-41e0-90c3-89afc00b68ac'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.616706 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb4071b1dd94f338bd3c0c5c30de19a', 'request_id': 'req-f766df0c-8281-41e0-90c3-89afc00b68ac'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.623115 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb4071b1dd94f338bd3c0c5c30de19a', 'request_id': 'req-f766df0c-8281-41e0-90c3-89afc00b68ac'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.633865 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] The token cache is being invalidate because project bfb4071b1dd94f338bd3c0c5c30de19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:58.634153 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.634785 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.636294 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1412/2849] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:58 2022] DELETE /identity/v3/projects/bfb4071b1dd94f338bd3c0c5c30de19a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:58.641210 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:58.650588 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d7eb-47dc-4a18-9345-d4b9fd192b30 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:58.706991 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:58.707689 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:58.708017 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:58.708261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] PATH_INFO: `/v3/users/f7bae2badc134191817cda7ad6b47c12` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:58.709430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bae2badc134191817cda7ad6b47c12)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:58.711341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:58.755619 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bae2badc134191817cda7ad6b47c12'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.756270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bae2badc134191817cda7ad6b47c12'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.768659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bae2badc134191817cda7ad6b47c12'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.769306 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bae2badc134191817cda7ad6b47c12'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.775979 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f6ff036b-014a-4024-9827-67bb3ffebf14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bae2badc134191817cda7ad6b47c12'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:58.788341 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1438/2850] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:21:58 2022] DELETE /identity/v3/users/f7bae2badc134191817cda7ad6b47c12 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:59.055100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.056563 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:59.071318 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766df0c-8281-41e0-90c3-89afc00b68ac admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.134955 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.135649 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.135886 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.136162 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] PATH_INFO: `/v3/projects/dd50a59c54544b798ed78f242deba2e1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.137532 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd50a59c54544b798ed78f242deba2e1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.139466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.185811 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd50a59c54544b798ed78f242deba2e1', 'request_id': 'req-9c42cb84-2da5-4f61-8475-493328567fb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:59.193163 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd50a59c54544b798ed78f242deba2e1', 'request_id': 'req-9c42cb84-2da5-4f61-8475-493328567fb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:59.198687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd50a59c54544b798ed78f242deba2e1', 'request_id': 'req-9c42cb84-2da5-4f61-8475-493328567fb8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:59.209815 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] The token cache is being invalidate because project dd50a59c54544b798ed78f242deba2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:21:59.210101 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:59.210729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9c42cb84-2da5-4f61-8475-493328567fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:21:59.212227 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1413/2851] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:21:59 2022] DELETE /identity/v3/projects/dd50a59c54544b798ed78f242deba2e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:59.219068 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b943-63fd-4855-8a0f-7aa9f247627f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.219610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b943-63fd-4855-8a0f-7aa9f247627f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.219610 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b943-63fd-4855-8a0f-7aa9f247627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.239050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a969b943-63fd-4855-8a0f-7aa9f247627f None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:59.240214 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a969b943-63fd-4855-8a0f-7aa9f247627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:59.278705 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:59.301692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1439/2852] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:59.311566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913cbe-02a1-4a01-883c-25b69c7bf641 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.311849 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913cbe-02a1-4a01-883c-25b69c7bf641 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.312124 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913cbe-02a1-4a01-883c-25b69c7bf641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.331746 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f1913cbe-02a1-4a01-883c-25b69c7bf641 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:59.332927 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f1913cbe-02a1-4a01-883c-25b69c7bf641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:59.341340 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1414/2853] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:59.345521 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969b943-63fd-4855-8a0f-7aa9f247627f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.355074 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969b943-63fd-4855-8a0f-7aa9f247627f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.360185 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.360777 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.361052 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.361321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.361962 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:21:59.362257 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.363879 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.375162 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1440/2854] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:21:59.379474 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1913cbe-02a1-4a01-883c-25b69c7bf641 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.388832 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1913cbe-02a1-4a01-883c-25b69c7bf641 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.393463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.394052 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.394326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.394595 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.395216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.397156 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.427193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1415/2855] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:21:59 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:59.431290 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.441263 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc934-264c-46e6-8d03-cd76eaa94297 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.496711 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.497223 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.497497 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.497765 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.498376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.500293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.520933 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1441/2856] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:21:59 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:21:59.525019 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.536534 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245a07-7eed-4013-9967-a1c64c43f4c4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.541535 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.542134 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.542414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.542734 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.543626 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.545216 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.555174 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1416/2857] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:59.559495 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.569599 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e9652-3f4b-4488-8ab0-d4cb13da3821 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.575027 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab52297-f628-47b4-8fb2-7552134638f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.575403 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52297-f628-47b4-8fb2-7552134638f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.575699 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52297-f628-47b4-8fb2-7552134638f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.575964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52297-f628-47b4-8fb2-7552134638f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.576587 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab52297-f628-47b4-8fb2-7552134638f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.578202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab52297-f628-47b4-8fb2-7552134638f1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.588730 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1442/2858] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:21:59.593498 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.603439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8c93b-96b1-4ae7-b1a4-1059935c8dd4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.608219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.608861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.609138 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.609410 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] PATH_INFO: `/v3/projects/aa1f3709b75442dca53c26b101ef8ae5/users/6b3af1f67b1c49bb925ad481cb44451d/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.620253 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:21:59.625978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1f3709b75442dca53c26b101ef8ae5, user_id=6b3af1f67b1c49bb925ad481cb44451d, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.628792 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.642320 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1417/2859] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:21:59 2022] PUT /identity/v3/projects/aa1f3709b75442dca53c26b101ef8ae5/users/6b3af1f67b1c49bb925ad481cb44451d/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:21:59.654099 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c33ab-4e20-499b-ab64-5d740be12a6e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.654383 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c33ab-4e20-499b-ab64-5d740be12a6e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.654679 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c33ab-4e20-499b-ab64-5d740be12a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.681690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dd7c33ab-4e20-499b-ab64-5d740be12a6e None None] MFA Rules not processed for user `6b3af1f67b1c49bb925ad481cb44451d`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:21:59.682881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dd7c33ab-4e20-499b-ab64-5d740be12a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:59.745297 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1443/2860] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:21:59.756400 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:21:59.758069 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:21:59.833661 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7be03-f1c3-49c6-8aee-98f63b68eaf5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:21:59.837273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca837c6-5bee-47bf-9072-4108710f79fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:21:59.837863 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca837c6-5bee-47bf-9072-4108710f79fb service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:21:59.838136 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca837c6-5bee-47bf-9072-4108710f79fb service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:21:59.838401 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca837c6-5bee-47bf-9072-4108710f79fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:21:59.846958 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca837c6-5bee-47bf-9072-4108710f79fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:21:59.848404 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca837c6-5bee-47bf-9072-4108710f79fb service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:21:59.856861 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1418/2861] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:21:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:09.742184 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:09.853067 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:15.366202 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c33ab-4e20-499b-ab64-5d740be12a6e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:15.429093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c33ab-4e20-499b-ab64-5d740be12a6e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:15.434576 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:15.435207 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:15.435542 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:15.435821 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] PATH_INFO: `/v3/users/6b3af1f67b1c49bb925ad481cb44451d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:15.436932 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3af1f67b1c49bb925ad481cb44451d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:15.439086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:15.484304 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3af1f67b1c49bb925ad481cb44451d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:15.484965 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3af1f67b1c49bb925ad481cb44451d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:15.497938 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3af1f67b1c49bb925ad481cb44451d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:15.498608 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3af1f67b1c49bb925ad481cb44451d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:15.505348 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3af1f67b1c49bb925ad481cb44451d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:15.518493 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1444/2862] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:22:15 2022] DELETE /identity/v3/users/6b3af1f67b1c49bb925ad481cb44451d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:15.522957 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:15.523441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:15.523566 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:15.542164 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:15.543982 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:15.602088 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1419/2863] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:15.612613 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:15.614065 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:15.674222 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2cbfc-68c9-419f-83ab-441805c86250 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:15.677850 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0d9ee-9b90-46bc-8a3c-18f428f9e538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:15.678457 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d9ee-9b90-46bc-8a3c-18f428f9e538 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:15.678727 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d9ee-9b90-46bc-8a3c-18f428f9e538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:15.678994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d9ee-9b90-46bc-8a3c-18f428f9e538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:15.688235 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0d9ee-9b90-46bc-8a3c-18f428f9e538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:15.689646 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0d9ee-9b90-46bc-8a3c-18f428f9e538 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:15.698853 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1445/2864] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:15.965135 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:15.966686 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:15.980673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae28f73-387d-4fff-af7f-0e82d8543421 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:15.985726 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:15.986395 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:15.986671 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:15.986943 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] PATH_INFO: `/v3/projects/aa1f3709b75442dca53c26b101ef8ae5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:15.988127 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1f3709b75442dca53c26b101ef8ae5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:15.990039 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.047816 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1f3709b75442dca53c26b101ef8ae5', 'request_id': 'req-589610c7-0a17-46ee-abab-148ad6e27cad'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:16.056268 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1f3709b75442dca53c26b101ef8ae5', 'request_id': 'req-589610c7-0a17-46ee-abab-148ad6e27cad'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:16.062588 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1f3709b75442dca53c26b101ef8ae5', 'request_id': 'req-589610c7-0a17-46ee-abab-148ad6e27cad'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:16.074281 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] The token cache is being invalidate because project aa1f3709b75442dca53c26b101ef8ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:22:16.074568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:16.075220 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-589610c7-0a17-46ee-abab-148ad6e27cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:22:16.076717 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1420/2865] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:22:15 2022] DELETE /identity/v3/projects/aa1f3709b75442dca53c26b101ef8ae5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:16.081964 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25660f-ac85-4958-a944-be0f59092d4d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.082245 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25660f-ac85-4958-a944-be0f59092d4d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.082516 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25660f-ac85-4958-a944-be0f59092d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.103434 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3c25660f-ac85-4958-a944-be0f59092d4d None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:16.104626 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3c25660f-ac85-4958-a944-be0f59092d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:16.122351 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:16.168772 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1446/2866] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:16.176556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819bf7e-8741-4f0f-8d1b-7a6a9fb436eb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.176839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819bf7e-8741-4f0f-8d1b-7a6a9fb436eb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.177112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819bf7e-8741-4f0f-8d1b-7a6a9fb436eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.197037 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a819bf7e-8741-4f0f-8d1b-7a6a9fb436eb None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:16.198228 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a819bf7e-8741-4f0f-8d1b-7a6a9fb436eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:16.206574 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1421/2867] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:16.210824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25660f-ac85-4958-a944-be0f59092d4d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.221016 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25660f-ac85-4958-a944-be0f59092d4d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.225635 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.226232 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.226509 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.226781 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.227437 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:16.227746 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.229326 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.240583 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1447/2868] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 08:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:16.244740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819bf7e-8741-4f0f-8d1b-7a6a9fb436eb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.254048 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819bf7e-8741-4f0f-8d1b-7a6a9fb436eb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.258579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.259157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.259452 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.259722 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.260360 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.262956 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.292640 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1422/2869] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:22:16 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:22:16.297093 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.307344 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf9983-e2f9-4fcf-8ac3-ae8ac0be01b8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.361997 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.362595 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.362872 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.363142 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.363790 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.365690 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.388347 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1448/2870] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:22:16 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:22:16.392459 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.402870 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461633a-2c0b-48cf-a726-bea99dde736b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.407513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.408104 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.408388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.408660 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.409299 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.411171 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.420908 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1423/2871] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:22:16.424867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.435283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b38d82-45d5-4136-b3c4-8c61bbacb3a8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.440230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadd5a0-3911-4aa1-ad1b-e5562c410733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.440827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd5a0-3911-4aa1-ad1b-e5562c410733 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.441104 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd5a0-3911-4aa1-ad1b-e5562c410733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.441376 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd5a0-3911-4aa1-ad1b-e5562c410733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.442420 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd5a0-3911-4aa1-ad1b-e5562c410733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.444062 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd5a0-3911-4aa1-ad1b-e5562c410733 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.455274 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1449/2872] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:22:16.459303 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.469665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af9f5-6237-4e83-9c14-b6debd910fe4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.474264 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.474900 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.475180 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.475485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] PATH_INFO: `/v3/projects/9eb7921864ff43c484299ec13c114e78/users/4f59bb6ab1f944a1b9b9f6c6178c3b89/roles/e606be389f29465393427b1abb34b098` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.489624 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb7921864ff43c484299ec13c114e78, user_id=4f59bb6ab1f944a1b9b9f6c6178c3b89, role_id=e606be389f29465393427b1abb34b098)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.492441 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.505791 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1424/2873] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:22:16 2022] PUT /identity/v3/projects/9eb7921864ff43c484299ec13c114e78/users/4f59bb6ab1f944a1b9b9f6c6178c3b89/roles/e606be389f29465393427b1abb34b098 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:16.510877 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50968f1-19b4-4445-a59d-f94b484c762e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.511317 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50968f1-19b4-4445-a59d-f94b484c762e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.512176 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50968f1-19b4-4445-a59d-f94b484c762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.530698 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a50968f1-19b4-4445-a59d-f94b484c762e None None] MFA Rules not processed for user `0c35a81a1058405d92e858b7156195a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:16.531983 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a50968f1-19b4-4445-a59d-f94b484c762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:16.589988 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1450/2874] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:16.601222 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.603061 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:16.624839 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:16.661673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111832e-0b79-498f-a117-d83666ed3d02 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.665275 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.665871 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.666146 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.666414 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.675429 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.676862 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.686529 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1425/2875] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:20.708270 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62257-f20d-4b78-84e7-c3abe33dc9de None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:20.708860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62257-f20d-4b78-84e7-c3abe33dc9de None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:20.708860 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62257-f20d-4b78-84e7-c3abe33dc9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:20.739692 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b7e62257-f20d-4b78-84e7-c3abe33dc9de None None] MFA Rules not processed for user `4f59bb6ab1f944a1b9b9f6c6178c3b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:20.740936 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b7e62257-f20d-4b78-84e7-c3abe33dc9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:20.763181 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:20.828622 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1451/2876] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:20.833794 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:20.844549 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c99e3-6748-4df3-97ea-3669e85d04dd service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:20.849673 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:20.850305 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:20.850579 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:20.850850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:20.851533 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:20.853517 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:20.892211 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1426/2877] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 08:22:20 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:20.896422 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62257-f20d-4b78-84e7-c3abe33dc9de None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:20.908019 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62257-f20d-4b78-84e7-c3abe33dc9de None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:20.978206 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:20.978827 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:20.979110 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:20.979386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:20.980109 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:20.982136 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:21.009994 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1452/2878] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 08:22:20 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:21.014918 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:21.027028 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d354-b454-4722-a019-59e1bc12bed3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:21.031772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:21.032425 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:21.032698 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:21.032973 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:21.033610 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:21.035193 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:21.051463 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1427/2879] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:22:21.055852 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:21.067007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127c76-c67c-468c-989d-355274d0940b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:21.071741 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:21.072423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:21.072706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:21.073007 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] PATH_INFO: `/v3/projects/cab2902f89a84e78999e3627984ba97d/users/3798a3984fac44b5801e906851d22638/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:21.094173 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab2902f89a84e78999e3627984ba97d, user_id=3798a3984fac44b5801e906851d22638, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:21.096919 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:21.111283 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1453/2880] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:22:21 2022] PUT /identity/v3/projects/cab2902f89a84e78999e3627984ba97d/users/3798a3984fac44b5801e906851d22638/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:21.115377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:21.128729 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c47fff-90dd-4695-9f2c-31794b8b855c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:21.193723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14365d9d-0889-4450-bc30-ce60c5d9ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:21.194249 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365d9d-0889-4450-bc30-ce60c5d9ef65 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:21.194558 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365d9d-0889-4450-bc30-ce60c5d9ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:21.194828 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365d9d-0889-4450-bc30-ce60c5d9ef65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:21.195513 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14365d9d-0889-4450-bc30-ce60c5d9ef65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:21.197212 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14365d9d-0889-4450-bc30-ce60c5d9ef65 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:21.210199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1428/2881] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 08:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:22:21.214335 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:21.225175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea83a6a-9e3b-4af3-bf88-a00f053e8366 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:21.231038 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:21.231728 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:21.232006 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:21.232272 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] PATH_INFO: `/v3/projects/cab2902f89a84e78999e3627984ba97d/users/3798a3984fac44b5801e906851d22638/roles/7f4fb728b8644985aa52cf747734ee50` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:21.234228 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab2902f89a84e78999e3627984ba97d, user_id=3798a3984fac44b5801e906851d22638, role_id=7f4fb728b8644985aa52cf747734ee50)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:21.237558 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:21.250653 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1454/2882] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 08:22:21 2022] PUT /identity/v3/projects/cab2902f89a84e78999e3627984ba97d/users/3798a3984fac44b5801e906851d22638/roles/7f4fb728b8644985aa52cf747734ee50 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:25.846928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899c09-27ae-4534-b511-1171be871872 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:25.847518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899c09-27ae-4534-b511-1171be871872 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:25.847518 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899c09-27ae-4534-b511-1171be871872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:25.884772 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ae899c09-27ae-4534-b511-1171be871872 None None] MFA Rules not processed for user `3798a3984fac44b5801e906851d22638`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:25.886114 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ae899c09-27ae-4534-b511-1171be871872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:25.970764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1429/2883] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:22:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:25.985018 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:25.986942 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:26.058660 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a01a-62d2-4289-9e24-5de12c2007c0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:26.065175 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7826aa1f8e4076ad5656f8cf7fe2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:26.065972 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.066315 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.066659 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.097049 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:26.130230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:26.131704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:26.140503 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1455/2884] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:26.258631 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b32b-4d94-456a-bafc-b436475c432c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.258914 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b32b-4d94-456a-bafc-b436475c432c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.259188 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b32b-4d94-456a-bafc-b436475c432c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.278397 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:26.314231 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5456b32b-4d94-456a-bafc-b436475c432c None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:26.315536 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5456b32b-4d94-456a-bafc-b436475c432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:26.379771 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1430/2885] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:22:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:26.426045 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:26.427514 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:26.517423 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b38ce-1679-420b-ae8b-4f6def1fbf2e service glance] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:26.523261 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:26.523670 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.524025 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.524428 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.534935 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:26.536546 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:26.545086 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1456/2886] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:22:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:22:35.108728 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.109229 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.109377 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.129616 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] MFA Rules not processed for user `4f59bb6ab1f944a1b9b9f6c6178c3b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:35.130733 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:35.137826 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1431/2887] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 08:22:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:35.401226 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:35.403446 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:35.460015 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4c894-b571-4a0e-906c-e7e00c78d4f6 service swift] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:35.463597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a94c0-5657-48a6-8b83-c464c4091ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:35.464873 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a94c0-5657-48a6-8b83-c464c4091ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.465220 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a94c0-5657-48a6-8b83-c464c4091ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.465490 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a94c0-5657-48a6-8b83-c464c4091ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.467219 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2e3a94c0-5657-48a6-8b83-c464c4091ce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:35.476597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a94c0-5657-48a6-8b83-c464c4091ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:35.478012 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a94c0-5657-48a6-8b83-c464c4091ce5 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:35.486683 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1457/2888] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:36.816906 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:36.818269 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:36.889713 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fda7-e3bf-44aa-a6c0-b6441b3f0b5f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:36.894555 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:36.895147 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:36.895502 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:36.895707 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:36.897422 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:36.909010 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:36.910571 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:36.921021 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1432/2889] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:38.221901 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42e97-8b7a-4a2c-b1cc-250d596737bd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.222454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42e97-8b7a-4a2c-b1cc-250d596737bd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.222454 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42e97-8b7a-4a2c-b1cc-250d596737bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.248971 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-69f42e97-8b7a-4a2c-b1cc-250d596737bd None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:38.251046 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-69f42e97-8b7a-4a2c-b1cc-250d596737bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:38.260954 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1458/2890] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 08:22:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:22:38.273635 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:38.286265 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee55b3-b4a4-4a3f-861e-75dcd77a04c2 service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.291850 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.293167 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.293457 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.293735 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.304901 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.306485 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:38.314977 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1433/2891] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:22:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 08:22:45.927131 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f42e97-8b7a-4a2c-b1cc-250d596737bd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:45.937672 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f42e97-8b7a-4a2c-b1cc-250d596737bd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:45.941562 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:45.942159 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:45.942436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:45.942704 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:45.944436 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:45.954602 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:45.956050 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:45.963906 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1459/2892] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:46.611018 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.612523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:46.670926 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:46.692687 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9026a-6bcf-4043-b3bb-de984dd38bcf service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.698388 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.698890 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.699157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.699434 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.701207 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:46.713308 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:46.715622 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:46.726273 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1434/2893] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:52.397883 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:52.413566 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c040-9476-48f4-a18e-69e27921a868 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:52.419059 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:52.419848 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.420780 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.421054 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.422771 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:52.434953 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:52.436706 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:52.447814 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1460/2894] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:22:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:22:56.721632 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=10 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:02.442969 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.665904 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.675813 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d948-295d-45f7-8549-2e3a23b0149d service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.679326 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465160a7e1c24601b83be37681ef322d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.679960 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.680241 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.680511 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.690099 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.691556 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.700704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1435/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:23:14.696704 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:23.361472 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:23.374331 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde7aef-1a46-4cf4-947e-12aa49f7d4f7 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:23.380246 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48a408-0239-4921-8186-86c77c7771f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e95079af6b4768bc38709a8bdc27bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:23.380957 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48a408-0239-4921-8186-86c77c7771f8 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.381303 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48a408-0239-4921-8186-86c77c7771f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.381652 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48a408-0239-4921-8186-86c77c7771f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.384141 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe48a408-0239-4921-8186-86c77c7771f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:23.397192 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48a408-0239-4921-8186-86c77c7771f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:23.399021 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48a408-0239-4921-8186-86c77c7771f8 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:23.410804 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1461/2896] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:24:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:24:28.779112 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:28.790383 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d4947-1979-404a-ab43-aee21597942c service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:28.795310 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:28.795928 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.796199 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.796466 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.798158 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:28.810648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:28.812233 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:28.823344 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1436/2897] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:24:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:24:29.647203 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:29.647710 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:29.647824 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:29.667041 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] MFA Rules not processed for user `3a5c88198c71414e99118fe595ad002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:29.668262 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:29.675230 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1462/2898] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 08:24:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:24:29.714284 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:29.725585 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a5433-450c-4d58-8b5e-bf13049d9c97 service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:29.730978 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666116325de04177accd2bfece858554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:29.731598 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:29.731879 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:29.732157 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:29.739990 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:29.741568 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:29.750100 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1437/2899] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 08:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:24:32.854697 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.858386 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:32.875242 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb16f3-fdf1-4679-911c-a3b81c0aacb2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.880430 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.881044 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.881321 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.881590 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.883847 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:32.895930 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.897449 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.908014 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1463/2900] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:24:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:24:36.096758 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.158842 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73390-4724-41d9-bf3d-c8efed808d85 service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.163744 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.164670 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.164946 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.165219 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] PATH_INFO: `/v3/users/4f59bb6ab1f944a1b9b9f6c6178c3b89` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.166583 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f59bb6ab1f944a1b9b9f6c6178c3b89)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.168749 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.218032 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f59bb6ab1f944a1b9b9f6c6178c3b89'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.231775 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f59bb6ab1f944a1b9b9f6c6178c3b89'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.239495 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f59bb6ab1f944a1b9b9f6c6178c3b89'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.240443 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f59bb6ab1f944a1b9b9f6c6178c3b89'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.241084 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f59bb6ab1f944a1b9b9f6c6178c3b89'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.258776 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1438/2901] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:24:36 2022] DELETE /identity/v3/users/4f59bb6ab1f944a1b9b9f6c6178c3b89 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:36.432978 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.444042 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2037e-03cd-4819-b0e6-e5af4b456376 service placement] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.500500 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.501119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.501392 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.501702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] PATH_INFO: `/v3/projects/9eb7921864ff43c484299ec13c114e78` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.502743 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb7921864ff43c484299ec13c114e78)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.504655 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.549970 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb7921864ff43c484299ec13c114e78', 'request_id': 'req-6a0dadf7-2c06-4fa2-9221-b71184080ebe'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.557810 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb7921864ff43c484299ec13c114e78', 'request_id': 'req-6a0dadf7-2c06-4fa2-9221-b71184080ebe'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.565244 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb7921864ff43c484299ec13c114e78', 'request_id': 'req-6a0dadf7-2c06-4fa2-9221-b71184080ebe'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.577985 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] The token cache is being invalidate because project 9eb7921864ff43c484299ec13c114e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:24:36.578269 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.578881 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.580375 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1464/2902] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:24:36 2022] DELETE /identity/v3/projects/9eb7921864ff43c484299ec13c114e78 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:36.584368 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.585764 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:36.598604 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea77c2-6f7c-4126-95aa-676ebf11a14c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.645364 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.655818 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.656439 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.656715 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.657013 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] PATH_INFO: `/v3/users/3798a3984fac44b5801e906851d22638` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.658142 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3798a3984fac44b5801e906851d22638)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.660090 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.703740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3798a3984fac44b5801e906851d22638'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.716014 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3798a3984fac44b5801e906851d22638'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.722539 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3798a3984fac44b5801e906851d22638'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.723189 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3798a3984fac44b5801e906851d22638'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.723810 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3798a3984fac44b5801e906851d22638'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:36.736665 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1439/2903] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 08:24:36 2022] DELETE /identity/v3/users/3798a3984fac44b5801e906851d22638 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:36.909119 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.910586 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:36.924043 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dadf7-2c06-4fa2-9221-b71184080ebe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.975371 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.982867 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c35a81a1058405d92e858b7156195a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1162a60112e4fd8987d9e032506b0a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.983738 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.984231 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.984920 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] PATH_INFO: `/v3/projects/cab2902f89a84e78999e3627984ba97d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.986360 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab2902f89a84e78999e3627984ba97d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.988731 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:37.034293 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab2902f89a84e78999e3627984ba97d', 'request_id': 'req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:37.041029 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab2902f89a84e78999e3627984ba97d', 'request_id': 'req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:37.046597 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab2902f89a84e78999e3627984ba97d', 'request_id': 'req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:37.058410 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] The token cache is being invalidate because project cab2902f89a84e78999e3627984ba97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:24:37.058702 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:37.059338 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a700007f-0c8a-4c6f-b80a-2dedbcd05e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:24:37.060833 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1465/2904] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 08:24:36 2022] DELETE /identity/v3/projects/cab2902f89a84e78999e3627984ba97d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:46.733523 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:47.055461 dv-cinder-781032-4-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:29:52.895179 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:29:52.896723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:29:53.039346 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f17d8-60df-45b8-a408-ee62f9060f9c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:29:53.099740 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6f6e0-0dce-478d-a605-10bdf8622010 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ab28faeca0b4289b501d17ceb360378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d7cf69e7a7e46a78e50bc1ec7d912cf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:29:53.100358 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f6e0-0dce-478d-a605-10bdf8622010 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:29:53.100639 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f6e0-0dce-478d-a605-10bdf8622010 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:29:53.100907 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f6e0-0dce-478d-a605-10bdf8622010 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:29:53.102648 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-daf6f6e0-0dce-478d-a605-10bdf8622010 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:29:53.114692 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6f6e0-0dce-478d-a605-10bdf8622010 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:29:53.116357 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6f6e0-0dce-478d-a605-10bdf8622010 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:29:53.127723 dv-cinder-781032-4-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1440/2905] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 08:29:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)